| 79 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 4,699,952+422 | 1018.10 GB | 31 Dec 2014 - 23:59 |
| Googlebot | 176,265+135 | 1.18 GB | 31 Dec 2014 - 23:59 |
| Mail.ru bot | 9,989+190 | 106.60 MB | 31 Dec 2014 - 23:59 |
| BaiDuSpider | 43,551+20 | 723.54 MB | 31 Dec 2014 - 23:59 |
| Yahoo Slurp | 69,124+58 | 979.87 MB | 31 Dec 2014 - 23:59 |
| Sogou Spider | 2,586+64 | 39.18 MB | 31 Dec 2014 - 23:59 |
| MJ12bot | 2,149+211 | 41.33 MB | 31 Dec 2014 - 23:59 |
| Yandex bot | 77,082+82 | 1.89 GB | 31 Dec 2014 - 23:58 |
| WebCollage | 2,154 | 58.77 MB | 31 Dec 2014 - 23:53 |
| Unknown robot (identified by 'spider') | 15,265+23 | 129.20 MB | 31 Dec 2014 - 23:50 |
| MSNBot-media | 173+148 | 7.72 MB | 31 Dec 2014 - 23:31 |
| Unknown robot (identified by 'bot*') | 30,424+464 | 309.93 MB | 31 Dec 2014 - 23:21 |
| FaceBook bot | 3,085 | 42.32 MB | 31 Dec 2014 - 23:18 |
| Feedfetcher-Google | 742 | 4.01 MB | 31 Dec 2014 - 23:15 |
| WebFilter | 38+13 | 1.02 MB | 31 Dec 2014 - 23:10 |
| Unknown robot (identified by hit on 'robots.txt') | 0+518 | 0 | 31 Dec 2014 - 23:09 |
| Bing Preview bot | 1,494 | 25.57 MB | 31 Dec 2014 - 23:05 |
| Additional Yahoo bots. | 162+1 | 4.33 MB | 31 Dec 2014 - 22:58 |
| NG 1.x (Exalead) | 17 | 1.03 MB | 31 Dec 2014 - 22:58 |
| Unknown robot (identified by 'crawl') | 968+208 | 15.45 MB | 31 Dec 2014 - 22:49 |
| Unknown robot (identified by empty user agent string) | 2,531+8 | 23.30 MB | 31 Dec 2014 - 22:34 |
| Exabot | 1,973+63 | 15.97 MB | 31 Dec 2014 - 22:00 |
| Suspected bot masqurading as Mozilla | 87+1 | 649.01 KB | 31 Dec 2014 - 20:30 |
| archive.org bot | 6,035+54 | 101.40 MB | 31 Dec 2014 - 20:06 |
| Unknown robot (identified by 'robot') | 16,959+12 | 231.00 MB | 31 Dec 2014 - 19:22 |
| FavIconizer | 276 | 6.20 MB | 31 Dec 2014 - 16:48 |
| ScoutJet crawler for Blekko. | 30+8 | 723.64 KB | 31 Dec 2014 - 16:26 |
| twitterbot | 93+84 | 1.28 MB | 31 Dec 2014 - 16:08 |
| Python-urllib | 172+5 | 1.82 MB | 31 Dec 2014 - 15:45 |
| Alexa (IA Archiver) | 133+45 | 5.06 MB | 31 Dec 2014 - 14:26 |
| yeti | 105+16 | 823.02 KB | 31 Dec 2014 - 13:12 |
| WordPress | 365 | 978.04 KB | 31 Dec 2014 - 13:06 |
| Jakarta commons-httpclient | 14+25 | 139.31 KB | 31 Dec 2014 - 10:05 |
| Unknown robot (identified by 'discovery') | 128 | 18.92 KB | 31 Dec 2014 - 09:18 |
| Sift | 122 | 4.36 MB | 31 Dec 2014 - 04:50 |
| Java (Often spam bot) | 468 | 7.15 MB | 31 Dec 2014 - 04:02 |
| Web Core / Roots | 166 | 7.31 MB | 31 Dec 2014 - 02:18 |
| longurl | 12 | 391.97 KB | 30 Dec 2014 - 20:35 |
| Drupal Site | 12 | 0 | 30 Dec 2014 - 09:43 |
| yacy | 0+2 | 0 | 29 Dec 2014 - 19:11 |
| Unknown robot (identified by 'checker') | 4 | 0 | 29 Dec 2014 - 09:15 |
| CFNetwork | 29 | 493.04 KB | 29 Dec 2014 - 08:10 |
| yie8 | 52 | 661.22 KB | 29 Dec 2014 - 00:40 |
| Suspected bot masqurading as Mozilla | 548 | 16.28 MB | 28 Dec 2014 - 23:12 |
| Nutch | 11+15 | 80.38 KB | 28 Dec 2014 - 18:30 |
| XYLEME Robot | 60 | 559.87 KB | 28 Dec 2014 - 11:04 |
| Custo | 3,619 | 40.49 MB | 27 Dec 2014 - 15:29 |
| WGet tools | 345 | 4.62 MB | 26 Dec 2014 - 20:31 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 5 | 14.55 KB | 26 Dec 2014 - 08:53 |
| A PHP script | 31 | 318.67 KB | 26 Dec 2014 - 05:54 |
| SeznamBot | 874+6 | 14.02 MB | 25 Dec 2014 - 17:26 |
| arks | 9 | 140.79 KB | 25 Dec 2014 - 13:50 |
| MSNBot | 8 | 1012.94 KB | 25 Dec 2014 - 10:09 |
| Perl tool | 76 | 665.89 KB | 25 Dec 2014 - 01:11 |
| Phantom | 28 | 367.25 KB | 25 Dec 2014 - 00:27 |
| metauri | 1 | 0 | 25 Dec 2014 - 00:09 |
| proximic | 9+8 | 41.37 KB | 24 Dec 2014 - 18:40 |
| Unknown robot (identified by '*bot') | 4+3 | 214.23 KB | 24 Dec 2014 - 04:46 |
| Turn It In | 3+1 | 34.06 KB | 24 Dec 2014 - 03:15 |
| Suspected bot masquerading as M$ IE | 4 | 27.43 KB | 22 Dec 2014 - 13:26 |
| MojeekBot | 2+2 | 178.15 KB | 22 Dec 2014 - 04:38 |
| W3C Link Checker | 3+3 | 0 | 21 Dec 2014 - 17:31 |
| Heritrix | 2,989+2 | 38.65 MB | 21 Dec 2014 - 13:55 |
| Pioneer | 1 | 15.42 KB | 21 Dec 2014 - 10:19 |
| youdao | 5 | 39.91 KB | 18 Dec 2014 - 23:42 |
| BetaBot | 114+8 | 2.98 MB | 17 Dec 2014 - 04:16 |
| inagist | 1 | 7.60 KB | 14 Dec 2014 - 16:55 |
| ichiro | 1+1 | 4.52 KB | 14 Dec 2014 - 13:36 |
| butterfly | 3 | 73.85 KB | 14 Dec 2014 - 01:19 |
| psbot | 1+1 | 7.74 KB | 11 Dec 2014 - 08:05 |
| Google AdSense | 1 | 12.15 KB | 10 Dec 2014 - 18:12 |
| TITAN | 2 | 25.58 KB | 10 Dec 2014 - 17:25 |
| Netcraft | 3 | 8.41 KB | 10 Dec 2014 - 08:36 |
| Y!J Yahoo Japan | 1+1 | 132 Bytes | 10 Dec 2014 - 04:48 |
| LinkChecker | 2 | 0 | 09 Dec 2014 - 17:18 |
| MOMspider | 1+1 | 0 | 08 Dec 2014 - 07:02 |
| TestBot | 46+1 | 597.14 KB | 03 Dec 2014 - 18:21 |
| Others | 0 | 13 Bytes | |
|