| 69 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 1,261,451+5853 | 212.79 GB | 31 Dec 2015 - 23:59 |
| Yahoo Slurp | 160,140+66 | 9.62 GB | 31 Dec 2015 - 23:59 |
| Googlebot | 109,273+96 | 1.16 GB | 31 Dec 2015 - 23:59 |
| Unknown robot (identified by 'bot*') | 89,362+1327 | 1013.70 MB | 31 Dec 2015 - 23:42 |
| Unknown robot (identified by 'crawl') | 53,228+420 | 631.12 MB | 31 Dec 2015 - 21:31 |
| Yandex bot | 29,749+130 | 685.64 MB | 31 Dec 2015 - 23:58 |
| Ruby script | 14,459 | 91.34 MB | 29 Dec 2015 - 01:44 |
| BaiDuSpider | 13,958 | 169.02 MB | 31 Dec 2015 - 23:59 |
| Unknown robot (identified by 'spider') | 7,674+8 | 64.92 MB | 31 Dec 2015 - 23:55 |
| Unknown robot (identified by empty user agent string) | 6,234+11 | 14.45 MB | 31 Dec 2015 - 09:20 |
| Nutch | 5,390+166 | 58.87 MB | 31 Dec 2015 - 23:48 |
| Y!J Yahoo Japan | 3,521+52 | 33.58 MB | 27 Dec 2015 - 19:08 |
| BetaBot | 3,441+120 | 46.27 MB | 31 Dec 2015 - 12:42 |
| Exabot | 3,337+44 | 23.40 MB | 31 Dec 2015 - 23:28 |
| archive.org bot | 2,885+46 | 62.59 MB | 29 Dec 2015 - 00:45 |
| Bing Preview bot | 2,510 | 58.11 MB | 31 Dec 2015 - 23:19 |
| Heritrix | 2,338+9 | 42.26 MB | 29 Dec 2015 - 18:05 |
| FaceBook bot | 2,147 | 39.43 MB | 31 Dec 2015 - 23:57 |
| MSNBot-media | 1,526+612 | 40.53 MB | 31 Dec 2015 - 23:47 |
| Feedfetcher-Google | 2,014 | 8.24 MB | 31 Dec 2015 - 23:32 |
| Sogou Spider | 1,558+58 | 114.12 MB | 31 Dec 2015 - 23:58 |
| Unknown robot (identified by 'robot') | 1,427+28 | 36.40 MB | 31 Dec 2015 - 12:54 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 1,343 | 232.81 KB | 31 Dec 2015 - 17:08 |
| Python-urllib | 1,328+2 | 17.41 MB | 31 Dec 2015 - 23:59 |
| Custo | 744 | 6.89 MB | 29 Dec 2015 - 21:49 |
| WGet tools | 597+1 | 9.65 MB | 31 Dec 2015 - 23:39 |
| WordPress | 568 | 6.17 MB | 31 Dec 2015 - 12:29 |
| MJ12bot | 445+98 | 7.22 MB | 31 Dec 2015 - 23:00 |
| SeznamBot | 275+258 | 4.59 MB | 30 Dec 2015 - 15:53 |
| FavIconizer | 385 | 23.43 MB | 31 Dec 2015 - 23:44 |
| Unknown robot (identified by hit on 'robots.txt') | 0+316 | 0 | 31 Dec 2015 - 21:59 |
| Alexa (IA Archiver) | 134+50 | 1.79 MB | 31 Dec 2015 - 12:39 |
| Unknown robot (identified by 'discovery') | 168 | 354.85 KB | 31 Dec 2015 - 18:04 |
| yeti | 139+12 | 3.60 MB | 31 Dec 2015 - 23:42 |
| Additional Yahoo bots. | 84 | 1.96 MB | 31 Dec 2015 - 23:59 |
| ScoutJet crawler for Blekko. | 41+37 | 1.14 MB | 31 Dec 2015 - 16:55 |
| CFNetwork | 71 | 1.43 MB | 31 Dec 2015 - 16:46 |
| yie8 | 69 | 801.22 KB | 19 Dec 2015 - 12:21 |
| WebCollage | 63 | 1.86 MB | 31 Dec 2015 - 11:23 |
| twitterbot | 27+23 | 324.88 KB | 31 Dec 2015 - 18:00 |
| Phantom | 46 | 660.00 KB | 29 Dec 2015 - 19:25 |
| Java (Often spam bot) | 44 | 513.08 KB | 30 Dec 2015 - 07:25 |
| covario | 28 | 194.26 KB | 31 Dec 2015 - 19:01 |
| Perl tool | 24 | 135.97 KB | 27 Dec 2015 - 00:53 |
| Drupal Site | 14 | 0 | 29 Dec 2015 - 16:43 |
| longurl | 12 | 391.97 KB | 29 Dec 2015 - 06:03 |
| Web Core / Roots | 9+2 | 2.03 MB | 30 Dec 2015 - 05:49 |
| SpiderBot | 5+5 | 21.85 KB | 21 Dec 2015 - 18:12 |
| MSNBot | 9 | 311.09 KB | 21 Dec 2015 - 23:42 |
| Sift | 9 | 219.11 KB | 30 Dec 2015 - 15:50 |
| A PHP script | 8 | 160.19 KB | 23 Dec 2015 - 15:52 |
| MojeekBot | 4+4 | 192.28 KB | 29 Dec 2015 - 22:43 |
| Jakarta commons-httpclient | 7 | 41.99 KB | 28 Dec 2015 - 18:08 |
| Unknown robot (identified by 'scanner') | 4 | 68 Bytes | 24 Dec 2015 - 20:26 |
| Suspected bot masqurading as Mozilla | 3+1 | 156.57 KB | 26 Dec 2015 - 14:26 |
| metauri | 4 | 17.27 KB | 13 Dec 2015 - 05:28 |
| Netcraft | 3 | 8.36 KB | 09 Dec 2015 - 18:28 |
| Unknown robot (identified by '*bot') | 2+1 | 43.24 KB | 30 Dec 2015 - 16:30 |
| proximic | 0+3 | 0 | 23 Dec 2015 - 05:21 |
| TITAN | 3 | 57.45 KB | 30 Dec 2015 - 06:06 |
| butterfly | 2 | 53.83 KB | 27 Dec 2015 - 05:23 |
| CsCrawler | 1+1 | 8.36 KB | 15 Dec 2015 - 11:48 |
| TestBot | 1 | 8.64 KB | 13 Dec 2015 - 06:03 |
| youdao | 1 | 18.38 KB | 29 Dec 2015 - 02:01 |
| yacy | 1 | 65.33 KB | 23 Dec 2015 - 19:46 |
| Unknown robot (identified by 'checker') | 1 | 0 | 23 Dec 2015 - 17:43 |
| MSIECrawler | 1 | 6.59 KB | 11 Dec 2015 - 09:50 |
| Others | 0 | 4.67 KB | |
|