Created
October 29, 2025 13:00
-
-
Save juddlyon/6d9d3b7df2826ec53a9e7f97545f0916 to your computer and use it in GitHub Desktop.
bernard.txt
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| User-agent: BernardBot | |
| Allow: / | |
| User-agent: Ask Jeeves | |
| Allow: / | |
| User-agent: Xenu Link Sleuth | |
| Allow: / | |
| User-agent: Googlebot | |
| Allow: / | |
| User-agent: Bingbot | |
| Allow: / | |
| # bring marissa back | |
| User-agent: Slurp | |
| Allow: / | |
| # get off my lawn | |
| User-agent: Bytespider | |
| Disallow: / | |
| # not today satan | |
| User-agent: Meta-ExternalAgent | |
| Disallow: / | |
| User-agent: FacebookBot | |
| Disallow: / | |
| # scream my lovely frog SCREAM | |
| User-agent: Screaming Frog SEO Spider | |
| Allow: / | |
| # only because stox | |
| User-agent: AhrefsBot | |
| Allow: / | |
| # for the ttt homies | |
| User-agent: SemrushBot | |
| Allow: / | |
| # seomoz.org | |
| User-agent: DotBot | |
| Allow: / | |
| # democracy dies in darkness | |
| User-agent: Amazonbot | |
| Disallow: / | |
| User-agent: Google-Extended | |
| Disallow: / | |
| User-agent: ClaudeBot | |
| Disallow: / | |
| User-agent: GPTBot | |
| Disallow: / | |
| # boris cherny for president | |
| User-agent: Claude-User | |
| Allow: / | |
| User-agent: ChatGPT-User | |
| Disallow: / | |
| # knew a guy who worked there who was cool | |
| User-agent: cohere-ai | |
| Disallow: / | |
| User-agent: CCBot | |
| Disallow: / | |
| User-agent: PerplexityBot | |
| Disallow: / | |
| # still at it | |
| User-agent: MJ12bot | |
| Allow: / | |
| # welcome anytime | |
| User-agent: DataForSeoBot | |
| Allow: / | |
| User-agent: ia_archiver | |
| Allow: / | |
| User-agent: * | |
| Disallow: / |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment