The Robots Exclusion Protocol (REP), better known as robots.txt, has been around since 1994. Even though it was only officially adopted as a standard in 2022, using a robots.txt file has been a core ...

A front-end interface for getting the results for a domain is available here. This project aims to implement a simple way to scan a list of domains for security.txt files (as per RFC 9116: A File ...

You can create a release to package software, along with release notes and links to binary files, for other people to use. Learn more about releases in our docs.