| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 99,876+644 | 1.09 GB | 31 Jul 2011 - 23:57 |
| Googlebot | 58,537+85 | 754.06 MB | 31 Jul 2011 - 23:59 |
| Yahoo Slurp | 57,252+161 | 644.78 MB | 31 Jul 2011 - 23:59 |
| Yandex bot | 24,473+93 | 250.22 MB | 31 Jul 2011 - 23:58 |
| Unknown robot (identified by 'robot') | 17,300+32 | 115.73 MB | 31 Jul 2011 - 21:38 |
| MSNBot | 15,698+27 | 209.92 MB | 31 Jul 2011 - 04:05 |
| Custo | 13,021+8 | 105.10 MB | 31 Jul 2011 - 15:31 |
| Unknown robot (identified by 'crawl') | 12,472+125 | 126.54 MB | 31 Jul 2011 - 23:59 |
| BaiDuSpider | 11,227+22 | 90.27 MB | 31 Jul 2011 - 23:52 |
| bender focused_crawler | 7,824+40 | 173.71 MB | 31 Jul 2011 - 11:30 |
| Unknown robot (identified by '*bot') | 7,492+350 | 75.43 MB | 31 Jul 2011 - 23:28 |
| Unknown robot (identified by 'spider') | 5,277+21 | 56.50 MB | 31 Jul 2011 - 23:46 |
| MSNBot-media | 3,320+957 | 66.74 MB | 31 Jul 2011 - 21:20 |
| archive.org bot | 3,033+3 | 52.27 MB | 19 Jul 2011 - 20:16 |
| psbot | 2,546+69 | 16.87 MB | 31 Jul 2011 - 22:26 |
| Speedy Spider | 2,121+240 | 21.55 MB | 31 Jul 2011 - 21:12 |
| Unknown robot (identified by empty user agent string) | 1,650+640 | 23.53 MB | 31 Jul 2011 - 23:44 |
| Motor | 1,963 | 21.85 MB | 30 Jul 2011 - 04:06 |
| Sogou Spider | 1,493+8 | 16.31 MB | 31 Jul 2011 - 19:40 |
| MJ12bot | 1,223+104 | 33.18 MB | 31 Jul 2011 - 13:38 |
| Unknown robot (identified by hit on 'robots.txt') | 0+652 | 0 | 31 Jul 2011 - 22:39 |
| FaceBook bot | 624 | 8.42 MB | 31 Jul 2011 - 23:41 |
| Exabot | 502+33 | 3.97 MB | 31 Jul 2011 - 21:21 |
| OutfoxBot/YodaoBot | 353 | 4.02 MB | 31 Jul 2011 - 22:40 |
| ichiro | 302+28 | 11.40 MB | 31 Jul 2011 - 12:26 |
| Feedfetcher-Google | 278 | 2.39 MB | 31 Jul 2011 - 23:23 |
| WebCollage | 230 | 4.26 MB | 31 Jul 2011 - 18:45 |
| WordPress | 226 | 488.58 KB | 29 Jul 2011 - 21:42 |
| Nutch | 141+23 | 3.64 MB | 31 Jul 2011 - 00:20 |
| Turn It In | 153+2 | 3.76 MB | 22 Jul 2011 - 17:04 |
| Alexa (IA Archiver) | 70+48 | 1.35 MB | 30 Jul 2011 - 09:08 |
| legs | 27+30 | 327.73 KB | 27 Jul 2011 - 23:33 |
| CFNetwork | 48 | 1.06 MB | 30 Jul 2011 - 23:00 |
| Unknown robot (identified by 'discovery') | 23+16 | 8.76 KB | 30 Jul 2011 - 09:05 |
| BSpider | 8+25 | 96.76 KB | 31 Jul 2011 - 20:41 |
| Findlinks | 18+12 | 288.57 KB | 29 Jul 2011 - 20:39 |
| java\/[0-9] | 24+1 | 301.60 KB | 26 Jul 2011 - 16:38 |
| TITAN | 23 | 240.93 KB | 04 Jul 2011 - 07:47 |
| Web Core / Roots | 15 | 400.69 KB | 11 Jul 2011 - 04:41 |
| Voila | 8+5 | 455.99 KB | 30 Jul 2011 - 03:48 |
| GigaBot | 5+5 | 66.59 KB | 26 Jul 2011 - 22:26 |
| WallPaper (alias crawlpaper) | 9 | 308.29 KB | 26 Jul 2011 - 13:52 |
| Perl tool | 9 | 19.59 KB | 29 Jul 2011 - 07:47 |
| HTTrack off-line browser | 5+4 | 48.19 KB | 25 Jul 2011 - 04:47 |
| MSIECrawler | 1+7 | 8.85 KB | 31 Jul 2011 - 10:38 |
| WGet tools | 6 | 68.14 KB | 27 Jul 2011 - 13:46 |
| Ask | 4+2 | 157.88 KB | 08 Jul 2011 - 14:11 |
| larbin | 3+3 | 34.96 KB | 21 Jul 2011 - 06:12 |
| Netcraft | 4 | 23.30 KB | 28 Jul 2011 - 17:28 |
| Heritrix | 1+2 | 7.38 KB | 02 Jul 2011 - 18:34 |
| Powermarks | 2 | 618.15 KB | 09 Jul 2011 - 19:01 |
| Jakarta commons-httpclient | 2 | 17.08 KB | 26 Jul 2011 - 10:40 |
| MOMspider | 1+1 | 0 | 07 Jul 2011 - 11:59 |
| yacy | 1+1 | 8.85 KB | 12 Jul 2011 - 03:12 |
| The web archive (IA Archiver) | 0+1 | 0 | 01 Jul 2011 - 10:26 |
| EasyDL | 1 | 11.65 KB | 06 Jul 2011 - 15:27 |
| Cursor | 1 | 11.65 KB | 03 Jul 2011 - 00:57 |
| FavIconizer | 1 | 11.65 KB | 29 Jul 2011 - 10:41 |
| VORTEX | 1 | 69.41 KB | 06 Jul 2011 - 10:37 |
|