Skip to content

Instantly share code, notes, and snippets.

@vivirenremoto
Created May 18, 2020 16:47
Show Gist options
  • Save vivirenremoto/f2462af7b66591823b92e2c8933c8f69 to your computer and use it in GitHub Desktop.
Save vivirenremoto/f2462af7b66591823b92e2c8933c8f69 to your computer and use it in GitHub Desktop.
$bots = array();
$bots[] = "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z‡ Safari/537.36";
$bots[] = "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)";
$bots[] = "Googlebot-Image/1.0";
$bots[] = "Googlebot/2.1 (+http://www.google.com/bot.html)";
$bots[] = "Mozilla/5.0 (compatible; Bingbot/2.0; +http://www.bing.com/bingbot.htm)";
$bots[] = "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)";
$bots[] = "DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)";
$bots[] = "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)";
$bots[] = "facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)";
$bots[] = "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)";
$bots[] = "ia_archiver (+http://www.alexa.com/site/help/webmasters; [email protected])";
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment