| 56 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 199,106+67 | 2.41 GB | 30 Apr 2013 - 23:59 |
| Unknown robot (identified by 'bot*') | 2,561,834+438 | 469.78 GB | 30 Apr 2013 - 23:59 |
| BaiDuSpider | 284,742 | 49.98 GB | 30 Apr 2013 - 23:59 |
| Feedfetcher-Google | 482 | 2.96 MB | 30 Apr 2013 - 23:59 |
| WebCollage | 22,069 | 476.69 MB | 30 Apr 2013 - 23:58 |
| CFNetwork | 758 | 15.12 MB | 30 Apr 2013 - 23:58 |
| Yandex bot | 23,234+100 | 283.48 MB | 30 Apr 2013 - 23:58 |
| Unknown robot (identified by '*bot') | 24,811+416 | 265.11 MB | 30 Apr 2013 - 23:58 |
| Yahoo Slurp | 14,522+111 | 156.39 MB | 30 Apr 2013 - 23:58 |
| Unknown robot (identified by 'robot') | 10,265+39 | 99.07 MB | 30 Apr 2013 - 23:57 |
| MSNBot-media | 61,310+21841 | 1.29 GB | 30 Apr 2013 - 23:57 |
| Unknown robot (identified by 'spider') | 40,325+56 | 337.97 MB | 30 Apr 2013 - 23:39 |
| Mail.ru bot | 1,132+11 | 15.80 MB | 30 Apr 2013 - 23:15 |
| BSpider | 411+10 | 25.94 MB | 30 Apr 2013 - 23:12 |
| Unknown robot (identified by hit on 'robots.txt') | 0+760 | 0 | 30 Apr 2013 - 22:54 |
| Sogou Spider | 6,343+46 | 65.25 MB | 30 Apr 2013 - 22:36 |
| Exabot | 2,616+60 | 16.84 MB | 30 Apr 2013 - 22:35 |
| Unknown robot (identified by 'discovery') | 3,097+10 | 36.10 MB | 30 Apr 2013 - 22:24 |
| FaceBook bot | 109+4 | 3.50 MB | 30 Apr 2013 - 21:56 |
| Unknown robot (identified by empty user agent string) | 4,878+2 | 93.03 MB | 30 Apr 2013 - 21:04 |
| Unknown robot (identified by 'crawl') | 10,106+30 | 130.64 MB | 30 Apr 2013 - 16:28 |
| ichiro | 105+22 | 3.86 MB | 30 Apr 2013 - 15:04 |
| MSNBot | 8,188+52 | 389.72 MB | 30 Apr 2013 - 13:51 |
| MJ12bot | 1,733+112 | 40.07 MB | 30 Apr 2013 - 13:49 |
| Alexa (IA Archiver) | 187+86 | 2.65 MB | 30 Apr 2013 - 13:20 |
| Python-urllib | 411+14 | 6.26 MB | 30 Apr 2013 - 12:40 |
| Y!J Yahoo Japan | 102+102 | 692.04 KB | 30 Apr 2013 - 03:33 |
| HTTrack off-line browser | 1,327,452+11 | 18.40 GB | 30 Apr 2013 - 02:00 |
| java\/[0-9] | 250 | 823.28 KB | 29 Apr 2013 - 17:25 |
| Jakarta commons-httpclient | 20 | 1.89 MB | 29 Apr 2013 - 16:58 |
| legs | 12+25 | 122.69 KB | 29 Apr 2013 - 13:32 |
| SeznamBot | 238+10 | 6.32 MB | 28 Apr 2013 - 20:43 |
| WordPress | 17 | 90.61 KB | 28 Apr 2013 - 14:50 |
| Nutch | 64+32 | 1.43 MB | 28 Apr 2013 - 09:41 |
| WebFilter | 29+6 | 480.94 KB | 28 Apr 2013 - 08:34 |
| Custo | 3,907+1 | 33.87 MB | 27 Apr 2013 - 18:27 |
| larbin | 19+3 | 604.24 KB | 25 Apr 2013 - 05:53 |
| Voila | 1+4 | 57.00 KB | 24 Apr 2013 - 20:53 |
| Google AdSense | 7 | 103.88 KB | 24 Apr 2013 - 20:29 |
| NG 1.x (Exalead) | 5 | 134.24 KB | 24 Apr 2013 - 00:10 |
| WallPaper (alias crawlpaper) | 3 | 45.74 KB | 23 Apr 2013 - 23:38 |
| psbot | 77+21 | 1.37 MB | 23 Apr 2013 - 23:36 |
| FavIconizer | 6 | 69.91 KB | 23 Apr 2013 - 22:00 |
| OutfoxBot/YodaoBot | 63 | 734.10 KB | 23 Apr 2013 - 15:38 |
| Web Core / Roots | 127 | 2.40 MB | 23 Apr 2013 - 07:03 |
| WGet tools | 21 | 71.43 KB | 22 Apr 2013 - 19:57 |
| Motor | 52 | 382.95 KB | 19 Apr 2013 - 08:42 |
| Unknown robot (identified by 'checker') | 2 | 0 | 19 Apr 2013 - 01:32 |
| MojeekBot | 0+1 | 0 | 17 Apr 2013 - 20:01 |
| Perl tool | 340 | 4.34 MB | 15 Apr 2013 - 15:47 |
| XYLEME Robot | 1 | 14.67 KB | 13 Apr 2013 - 05:48 |
| archive.org bot | 46+6 | 3.88 MB | 10 Apr 2013 - 10:29 |
| Netcraft | 3 | 11.65 KB | 10 Apr 2013 - 08:14 |
| MOMspider | 1+1 | 0 | 08 Apr 2013 - 02:53 |
| Phantom | 55 | 468.17 KB | 07 Apr 2013 - 01:25 |
| yacy | 1 | 11.65 KB | 04 Apr 2013 - 11:42 |
|