| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 113,893+73 | 1.67 GB | 31 Oct 2013 - 23:59 |
| Unknown robot (identified by 'bot*') | 2,174,789+452 | 418.52 GB | 31 Oct 2013 - 23:59 |
| BaiDuSpider | 24,652+47 | 824.25 MB | 31 Oct 2013 - 23:58 |
| Unknown robot (identified by 'spider') | 48,686+65 | 443.59 MB | 31 Oct 2013 - 23:58 |
| WebCollage | 18,845 | 473.87 MB | 31 Oct 2013 - 23:58 |
| MSNBot-media | 129,365+32988 | 2.34 GB | 31 Oct 2013 - 23:55 |
| Yandex bot | 71,185+87 | 319.90 MB | 31 Oct 2013 - 23:51 |
| Unknown robot (identified by '*bot') | 23,313+443 | 256.05 MB | 31 Oct 2013 - 23:44 |
| Unknown robot (identified by empty user agent string) | 1,306 | 33.32 MB | 31 Oct 2013 - 23:38 |
| FaceBook bot | 218 | 3.63 MB | 31 Oct 2013 - 23:38 |
| archive.org bot | 1,236+33 | 20.07 MB | 31 Oct 2013 - 23:24 |
| Unknown robot (identified by hit on 'robots.txt') | 0+707 | 0 | 31 Oct 2013 - 22:45 |
| Mail.ru bot | 4,730+217 | 41.66 MB | 31 Oct 2013 - 22:43 |
| Feedfetcher-Google | 489 | 3.10 MB | 31 Oct 2013 - 22:33 |
| Unknown robot (identified by 'crawl') | 149+62 | 5.51 MB | 31 Oct 2013 - 22:18 |
| Perl tool | 89 | 580.57 KB | 31 Oct 2013 - 21:48 |
| MSNBot | 14,209+84 | 319.77 MB | 31 Oct 2013 - 21:47 |
| Turn It In | 121+51 | 1.19 MB | 31 Oct 2013 - 21:40 |
| Alexa (IA Archiver) | 323+109 | 6.67 MB | 31 Oct 2013 - 20:08 |
| Custo | 15,135 | 128.30 MB | 31 Oct 2013 - 20:01 |
| WordPress | 54 | 25.08 KB | 31 Oct 2013 - 19:42 |
| ichiro | 122+19 | 2.94 MB | 31 Oct 2013 - 19:13 |
| Sogou Spider | 1,518+50 | 23.62 MB | 31 Oct 2013 - 18:46 |
| Exabot | 1,309+60 | 11.01 MB | 31 Oct 2013 - 18:14 |
| SeznamBot | 478+32 | 28.10 MB | 31 Oct 2013 - 15:55 |
| NG 1.x (Exalead) | 154 | 25.41 MB | 31 Oct 2013 - 11:33 |
| Unknown robot (identified by 'robot') | 14,720+36 | 188.00 MB | 31 Oct 2013 - 10:47 |
| Unknown robot (identified by 'discovery') | 781 | 8.22 KB | 31 Oct 2013 - 10:17 |
| CFNetwork | 209 | 3.85 MB | 31 Oct 2013 - 08:30 |
| Voila | 6+8 | 296.65 KB | 31 Oct 2013 - 04:35 |
| Jakarta commons-httpclient | 440 | 5.05 MB | 31 Oct 2013 - 04:04 |
| java\/[0-9] | 136+1 | 1.28 MB | 31 Oct 2013 - 04:02 |
| HTTrack off-line browser | 7,007+1 | 95.58 MB | 31 Oct 2013 - 01:46 |
| Web Core / Roots | 16 | 792.21 KB | 30 Oct 2013 - 23:09 |
| Motor | 75 | 871.82 KB | 30 Oct 2013 - 21:29 |
| MojeekBot | 14+16 | 223.74 KB | 30 Oct 2013 - 12:21 |
| Python-urllib | 301+11 | 17.79 MB | 30 Oct 2013 - 10:29 |
| Google AdSense | 25 | 260.05 KB | 30 Oct 2013 - 07:16 |
| FavIconizer | 5 | 58.26 KB | 29 Oct 2013 - 14:28 |
| Yahoo Slurp | 1,658+30 | 19.87 MB | 29 Oct 2013 - 01:20 |
| Unknown robot (identified by 'checker') | 4 | 16.84 KB | 28 Oct 2013 - 22:46 |
| Nutch | 70+12 | 596.02 KB | 27 Oct 2013 - 11:13 |
| MJ12bot | 181+50 | 6.48 MB | 26 Oct 2013 - 16:44 |
| WebFilter | 59+19 | 1.03 MB | 26 Oct 2013 - 16:18 |
| Sven | 11+1 | 93.63 KB | 26 Oct 2013 - 06:32 |
| yacy | 3+4 | 142.31 KB | 26 Oct 2013 - 00:24 |
| psbot | 736+50 | 5.90 MB | 24 Oct 2013 - 18:37 |
| WGet tools | 180+2 | 2.41 MB | 22 Oct 2013 - 19:01 |
| Y!J Yahoo Japan | 2+2 | 15.50 KB | 22 Oct 2013 - 00:56 |
| GigaBot | 6 | 477.53 KB | 20 Oct 2013 - 12:32 |
| Phantom | 21 | 243.01 KB | 19 Oct 2013 - 15:20 |
| MSIECrawler | 2 | 13.74 KB | 13 Oct 2013 - 13:02 |
| legs | 0+2 | 0 | 12 Oct 2013 - 19:33 |
| BSpider | 276 | 5.61 MB | 11 Oct 2013 - 22:39 |
| Netcraft | 5 | 11.65 KB | 11 Oct 2013 - 13:16 |
| NG 2.x (Exalead) | 38 | 438.58 KB | 09 Oct 2013 - 07:03 |
| MOMspider | 1+1 | 0 | 08 Oct 2013 - 10:37 |
| Fish search | 1 | 7.58 KB | 06 Oct 2013 - 07:39 |
| WallPaper (alias crawlpaper) | 1 | 26.80 KB | 05 Oct 2013 - 14:59 |
|