Last active
January 6, 2021 17:45
-
-
Save graysuit/853116f0bda96e5ac18afd107f340376 to your computer and use it in GitHub Desktop.
Nowadays, every professional website have their own bots and crawlers. These are used to fetch results from link/URL when a user share them. They track links to avoid phishing, scams and also for better link preview.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ๐๐จ๐จ๐ ๐ฅ๐: | |
| Googlebot | |
| Googlebot/2.1 | |
| Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | |
| ๐ ๐๐๐๐๐จ๐จ๐ค & ๐๐ง๐ฌ๐ญ๐๐ ๐ซ๐๐ฆ & ๐๐๐ฌ๐ฌ๐๐ง๐ ๐๐ซ: | |
| Facebot | |
| facebookexternalhit | |
| facebookexternalhit/1.1 | |
| facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) | |
| ๐๐ฐ๐ข๐ญ๐ญ๐๐ซ: | |
| Twitterbot | |
| Twitterbot/1.1 | |
| ๐๐ฎ๐ฆ๐๐ฅ๐ข๐ซ: | |
| Tumblr/14.0.835.186 | |
| ๐๐ข๐ง๐ค๐๐๐ข๐ง: | |
| LinkedInBot | |
| LinkedInBot/1.0 | |
| LinkedInBot/1.0 (compatible; Mozilla/5.0; Apache-HttpClient +http://www.linkedin.com) | |
| ๐๐ง๐๐ฉ๐๐ก๐๐ญ: | |
| Snapchat | |
| Snapchat/10.12.0.2 | |
| Snapchat/10.12.0.2 (iPhone8,1; iOS 10.3.2; gzip) | |
| ๐๐๐ก๐จ๐จ: | |
| Slurp | |
| Yahoo! Slurp | |
| Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) | |
| ๐๐ข๐๐ซ๐จ๐ฌ๐จ๐๐ญ: | |
| Microsoft-BotFramework | |
| Microsoft-BotFramework/3.0 | |
| BF-DirectLine/3.0 (Microsoft-BotFramework/3.0 +https://botframework.com/ua) | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment