Skip to content

Instantly share code, notes, and snippets.

@jaydonnell

jaydonnell/gist:971893

Created May 14, 2011 03:28
Show Gist options
  • Save jaydonnell/971893 to your computer and use it in GitHub Desktop.
Save jaydonnell/971893 to your computer and use it in GitHub Desktop.
Download ZIP
bots
Raw
gistfile1.txt
yakkstr.com:80 77.88.25.26 - - [13/May/2011:19:57:52 -0700] "GET /tags/1703-glenn-beck HTTP/1.1" 200 1953 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
yakkstr.com:80 119.63.196.80 - - [13/May/2011:19:58:11 -0700] "GET /tags/28-introduction-of-sorts HTTP/1.1" 200 1953 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
yakkstr.com:80 67.195.113.242 - - [13/May/2011:19:58:19 -0700] "GET /tags/504-food HTTP/1.0" 200 4584 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
yakkstr.com:80 66.249.67.242 - - [13/May/2011:19:59:58 -0700] "GET /posts/3240-Borders-bookstores-gives-executives-8300000-in-bonuses-after-it-lays-off-6000-workers-and-goes-into-chapter-11-bankruptcy- HTTP/1.1" 200 5011 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
yakkstr.com:80 77.88.25.26 - - [13/May/2011:20:00:02 -0700] "GET /posts/1535-Its-piling-up HTTP/1.1" 200 5625 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
yakkstr.com:80 119.63.196.109 - - [13/May/2011:20:00:57 -0700] "GET /tags/1833-website HTTP/1.1" 200 2148 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
yakkstr.com:80 77.88.25.26 - - [13/May/2011:20:02:12 -0700] "GET /users/paper HTTP/1.1" 200 3259 "-" "Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
yakkstr.com:80 66.249.67.242 - - [13/May/2011:20:02:29 -0700] "GET /posts/1439-Day-22 HTTP/1.1" 200 4358 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment