Skip to content

Instantly share code, notes, and snippets.

@joshnuss

joshnuss/robots.txt

Created September 23, 2024 07:13
Show Gist options
  • Save joshnuss/72c57c52514c76c7899d638e06a039e3 to your computer and use it in GitHub Desktop.
Save joshnuss/72c57c52514c76c7899d638e06a039e3 to your computer and use it in GitHub Desktop.
Download ZIP
Block AI crawlers
Raw
robots.txt
User-agent: GPTBot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Amazonbot
Disallow: /
User-agent: Applebot
Disallow: /
@joshnuss
Copy link
Author

Blocks OpenAI, Google Bard, Amazon Alex, Apple Siri

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment