About · our crawler
Who is asking
If you found this address in your server logs, this page is for you. It says what our crawler is, what it honours, what it will never do, and how to tell us to stop or to let us in.
Reading the page
Source: Outpost’s own crawler policy, read live from the same code our build checks run against. The refusal register is our own record of who told us no. None of this is a government feed.