| 65 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'spider') | 94,883+12 | 631.13 MB | 31 Jan 2011 - 23:58 |
| Yahoo Slurp | 64,220+143 | 658.00 MB | 31 Jan 2011 - 23:59 |
| Yandex bot | 61,150+93 | 646.09 MB | 31 Jan 2011 - 23:59 |
| MSNBot-media | 39,211+2462 | 761.59 MB | 31 Jan 2011 - 23:32 |
| Googlebot | 38,390+84 | 545.20 MB | 31 Jan 2011 - 23:59 |
| Unknown robot (identified by 'crawl') | 32,223+225 | 355.57 MB | 31 Jan 2011 - 23:59 |
| Unknown robot (identified by 'bot*') | 28,354+2161 | 310.39 MB | 31 Jan 2011 - 23:58 |
| Unknown robot (identified by 'discovery') | 12,568+82 | 96.35 MB | 31 Jan 2011 - 23:59 |
| MSNBot | 5,605+24 | 82.47 MB | 28 Jan 2011 - 14:12 |
| BaiDuSpider | 3,714+52 | 48.85 MB | 31 Jan 2011 - 23:36 |
| Unknown robot (identified by 'robot') | 3,155+22 | 19.91 MB | 31 Jan 2011 - 22:19 |
| archive.org bot | 2,979+2 | 39.70 MB | 02 Jan 2011 - 19:04 |
| Speedy Spider | 933+298 | 8.50 MB | 31 Jan 2011 - 22:15 |
| WebCollage | 1,102 | 32.87 MB | 31 Jan 2011 - 23:59 |
| Unknown robot (identified by empty user agent string) | 921+99 | 12.82 MB | 31 Jan 2011 - 22:23 |
| Custo | 727+7 | 9.47 MB | 24 Jan 2011 - 17:49 |
| Motor | 718 | 7.60 MB | 29 Jan 2011 - 12:17 |
| ichiro | 554+13 | 11.38 MB | 31 Jan 2011 - 23:46 |
| MJ12bot | 339+45 | 5.78 MB | 31 Jan 2011 - 04:35 |
| Unknown robot (identified by hit on 'robots.txt') | 0+355 | 0 | 31 Jan 2011 - 22:08 |
| Exabot | 262+34 | 2.12 MB | 31 Jan 2011 - 23:01 |
| Feedfetcher-Google | 242 | 2.09 MB | 31 Jan 2011 - 23:25 |
| CFNetwork | 219 | 2.47 MB | 31 Jan 2011 - 11:10 |
| Bobby | 204 | 2.19 MB | 17 Jan 2011 - 13:29 |
| Sogou Spider | 136+9 | 1.38 MB | 31 Jan 2011 - 17:53 |
| WGet tools | 134 | 10.91 KB | 28 Jan 2011 - 06:20 |
| Python-urllib | 99 | 3.75 MB | 28 Jan 2011 - 01:18 |
| Findlinks | 96+2 | 682.39 KB | 30 Jan 2011 - 20:56 |
| FaceBook bot | 76 | 1.39 MB | 27 Jan 2011 - 14:10 |
| Nutch | 29+21 | 731.41 KB | 31 Jan 2011 - 04:59 |
| VORTEX | 47 | 778.61 KB | 09 Jan 2011 - 09:03 |
| WordPress | 44 | 96.31 KB | 23 Jan 2011 - 13:41 |
| Alexa (IA Archiver) | 25+17 | 402.16 KB | 31 Jan 2011 - 08:15 |
| legs | 19+10 | 460.36 KB | 23 Jan 2011 - 16:02 |
| Ask | 16+12 | 631.27 KB | 27 Jan 2011 - 12:47 |
| bender focused_crawler | 15+12 | 416.16 KB | 28 Jan 2011 - 17:58 |
| NG 1.x (Exalead) | 26 | 309.36 KB | 24 Jan 2011 - 08:18 |
| BSpider | 21+5 | 9.00 MB | 31 Jan 2011 - 21:36 |
| Unknown robot (identified by '*bot') | 14+7 | 398.30 KB | 31 Jan 2011 - 21:55 |
| Perl tool | 13 | 43.66 KB | 11 Jan 2011 - 01:16 |
| WallPaper (alias crawlpaper) | 12 | 184.71 KB | 17 Jan 2011 - 16:46 |
| Voila | 8+4 | 455.99 KB | 30 Jan 2011 - 04:41 |
| GigaBot | 5+6 | 128.70 KB | 16 Jan 2011 - 03:03 |
| java\/[0-9] | 11 | 75.48 KB | 30 Jan 2011 - 20:53 |
| Powermarks | 6 | 81.48 KB | 30 Jan 2011 - 08:20 |
| Web Core / Roots | 5 | 60.55 KB | 20 Jan 2011 - 04:41 |
| Scooter | 0+5 | 0 | 25 Jan 2011 - 21:11 |
| Allrati | 4 | 35.32 KB | 22 Jan 2011 - 10:30 |
| The web archive (IA Archiver) | 0+4 | 0 | 31 Jan 2011 - 21:18 |
| MOMspider | 2+2 | 0 | 24 Jan 2011 - 15:56 |
| Netcraft | 3 | 11.63 KB | 25 Jan 2011 - 17:37 |
| EasyDL | 3 | 34.89 KB | 21 Jan 2011 - 01:35 |
| MSIECrawler | 3 | 61.71 KB | 13 Jan 2011 - 22:38 |
| Webdup | 2 | 18.52 KB | 10 Jan 2011 - 13:07 |
| Jakarta commons-httpclient | 2 | 45.13 KB | 25 Jan 2011 - 04:59 |
| Vagabondo | 1+1 | 25 Bytes | 02 Jan 2011 - 07:48 |
| Y!J Yahoo Japan | 1+1 | 34.67 KB | 18 Jan 2011 - 07:19 |
| MojeekBot | 1+1 | 8.83 KB | 08 Jan 2011 - 03:39 |
| larbin | 1+1 | 11.63 KB | 16 Jan 2011 - 03:01 |
| Mail.ru bot | 0+1 | 0 | 08 Jan 2011 - 10:16 |
| Digger | 1 | 11.63 KB | 08 Jan 2011 - 15:05 |
| HTTrack off-line browser | 1 | 12.78 KB | 17 Jan 2011 - 23:38 |
| Heritrix | 0+1 | 0 | 22 Jan 2011 - 04:46 |
| StackRambler | 0+1 | 0 | 19 Jan 2011 - 21:06 |
| FavIconizer | 1 | 11.63 KB | 05 Jan 2011 - 00:15 |
|