Skip to content

Instantly share code, notes, and snippets.

@thinkingcap
Created June 26, 2025 02:47
Show Gist options
  • Select an option

  • Save thinkingcap/a0fd7eee3d0424e37972c804da80ac6e to your computer and use it in GitHub Desktop.

Select an option

Save thinkingcap/a0fd7eee3d0424e37972c804da80ac6e to your computer and use it in GitHub Desktop.
if ($http_user_agent ~* "(?:acunetix|gptbot|BLEXBot|domaincrawler\.com|LinkpadBot|MJ12bot/v|majestic12\.co\.uk|bingbot|AhrefsBot|TwengaBot|SemrushBot|Amazonbot|nikto|winhttp|Xenu\s+Link\s+Sleuth|Baiduspider|HTTrack|clshttp|harvest|extract|grab|miner|python-requests|meta-externalagent)") {
return 403;
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment