gistfile1.txt

A total of 62 ROBOTS were logged 
   Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot) 1 Time(s) 
   Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) 169 Time(s) 
   Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2) Gecko/20100115 Firefox/3.6 (FlipboardProxy/1.1; +http://flipboard.com/browserproxy) 1 Time(s) 
   Mozilla/5.0 (X11; Ubuntu; Linux i686; rv:14.0; ips-agent) Gecko/20100101 Firefox/14.0.1 2 Time(s) 
   Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.89 Safari/537.1; 360Spider 4 Time(s) 
   Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) 10 Time(s) 
   Twitterbot/1.0 4 Time(s) 
   Mozilla/5.0 (compatible; coccoc/1.0; +http://help.coccoc.com/) 9 Time(s) 
   Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html) 3 Time(s) 
   Mozilla/5.0 (compatible; SiteExplorer/1.0b; +http://siteexplorer.info/) 1 Time(s) 
   ZemlyaCrawl/1.0 (+http://zemlyaozer.com/bot) 2 Time(s) 
   magpie-crawler/1.1 (U; Linux amd64; en-GB; +http://www.brandwatch.net) 2 Time(s) 
   msnbot-media/1.1 (+http://search.msn.com/msnbot.htm) 39 Time(s) 
   Mozilla/5.0 (compatible; SearchmetricsBot; http://www.searchmetrics.com/en/searchmetrics-bot/) 2 Time(s) 
   Mozilla/5.0 (compatible; SeznamBot/3.2; +http://fulltext.sblog.cz/) 1 Time(s) 
   Mozilla/5.0 (compatible; SeznamBot/3.2-test1; +http://fulltext.sblog.cz/) 2 Time(s) 
   Mozilla/5.0 (Windows NT 5.1; rv:6.0.2) Gecko/20100101 Firefox/6.0.2 22 Time(s) 
   Mozilla/5.0 (compatible; MSIE or Firefox mutant; not on Windows server; + http://tab.search.daum.net/aboutWebSearch.html) Daumoa/3.0 4 Time(s) 
   Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) 110 Time(s) 
   Mozilla/5.0 (compatible; Swiftbot/1.0; UID/52a8fe1714cc8a4195004452) 1 Time(s) 
   Mozilla/5.0 (compatible; URLAppendBot/1.0; +http://www.profound.net/urlappendbot.html) 2 Time(s) 
   Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) 17 Time(s) 
   Nutch12/Nutch-1.2 1 Time(s) 
   Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) 20 Time(s) 
   Mozilla/5.0 (compatible; archive.org_bot; Wayback Machine Live Record; +http://archive.org/details/archive.org_bot) 1 Time(s) 
   Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_2; en-US) AppleWebKit/533.3 (KHTML, like Gecko) Chrome/5.0.354.0 Safari/533.3 1 Time(s) 
   AdnormCrawler www.adnorm.com/crawler 2 Time(s) 
   SkimBot/1.0 (www.skimlinks.com <[email protected]>) 1 Time(s) 
   Mozilla/5.0 (compatible; Genieo/1.0 http://www.genieo.com/webfilter.html) 5 Time(s) 
   Domnutch-Bot/Nutch-1.0 (Domnutch; http://www.Nutch.de/) 8 Time(s) 
   Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; Trident/5.0); 360Spider 8 Time(s) 
   Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727) 1 Time(s) 
   PagesInventory (robot http://www.pagesinvenotry.com) 1 Time(s) 
   Mozilla/5.0 (compatible; Ezooms/1.0; [email protected]) 93 Time(s) 
   Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; InfoPath.2) 5 Time(s) 
   ZumBot/1.0 (ZUM Search; http://help.zum.com/inquiry) 1 Time(s) 
   Mozilla/5.0 (compatible; EasouSpider; +http://www.easou.com/search/spider.html) 2 Time(s) 
   Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 ([email protected]) 1 Time(s) 
   panscient.com 3 Time(s) 
   Mozilla/5.0 (compatible; proximic; +http://www.proximic.com/info/spider.php) 2 Time(s) 
   - 1 Time(s) 
   Mozilla/4.0 (sees.co bot) 1 Time(s) 
   Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/) 1 Time(s) 
   msnbot/2.0b (+http://search.msn.com/msnbot.htm) 7 Time(s) 
   Mozilla/5.0 (compatible; Kraken/0.1; http://linkfluence.net/; [email protected]) 4 Time(s) 
   netEstate NE Crawler (+http://www.website-datenbank.de/) 1 Time(s) 
   Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0; chromeframe/19.0.1084.52) 12 Time(s) 
   Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools) 4 Time(s) 
   Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) 63 Time(s) 
   Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729) 4 Time(s) 
   ShopWiki/1.0 ( +http://www.shopwiki.com/wiki/Help:Bot) 4 Time(s) 
   Mozilla/5.0 (X11; Linux i686) AppleWebKit/536.11 (KHTML, like Gecko) Chrome/20.0.1132.47 Safari/536.11 1 Time(s) 
   Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/) 6 Time(s) 
   Aboundex/0.3 (http://www.aboundex.com/crawler/) 5 Time(s) 
   Mozilla/5.0 (compatible; linkdexbot/2.0; +http://www.linkdex.com/about/bots/) 13 Time(s) 
   Mozilla/5.0 (compatible; FatBot 2.0; http://www.thefind.com/crawler) 3 Time(s) 
   CCBot/2.0 (http://commoncrawl.org/faq/) 20 Time(s) 
   Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots) 3 Time(s) 
   Mozilla/5.0 (compatible; MJ12bot/v1.4.4; http://www.majestic12.co.uk/bot.php?+) 34 Time(s) 
   ia_archiver (+http://www.alexa.com/site/help/webmasters; [email protected]) 1 Time(s) 
   Mozilla/5.0 (compatible; SISTRIX Crawler; http://crawler.sistrix.net/) 1 Time(s) 
   Mozilla/5.0 (compatible; spbot/4.0.8; +http://OpenLinkProfiler.org/bot ) 1 Time(s)