| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 66,472+78 | 904.72 MB | 31 Aug 2011 - 23:56 |
| Yahoo Slurp | 58,427+162 | 644.11 MB | 31 Aug 2011 - 23:59 |
| Yandex bot | 43,241+68 | 556.49 MB | 31 Aug 2011 - 23:59 |
| Unknown robot (identified by 'bot*') | 21,956+584 | 267.71 MB | 31 Aug 2011 - 23:59 |
| Unknown robot (identified by 'spider') | 22,198+15 | 300.36 MB | 31 Aug 2011 - 19:30 |
| Unknown robot (identified by 'robot') | 16,226+52 | 153.25 MB | 31 Aug 2011 - 06:11 |
| Unknown robot (identified by 'crawl') | 10,101+179 | 108.71 MB | 31 Aug 2011 - 23:59 |
| Unknown robot (identified by '*bot') | 8,140+363 | 81.15 MB | 31 Aug 2011 - 23:58 |
| MSNBot-media | 6,937+1348 | 128.54 MB | 31 Aug 2011 - 23:45 |
| MSNBot | 4,447+59 | 116.10 MB | 31 Aug 2011 - 22:53 |
| BaiDuSpider | 3,752+33 | 40.29 MB | 31 Aug 2011 - 23:58 |
| Unknown robot (identified by empty user agent string) | 2,736+256 | 41.19 MB | 31 Aug 2011 - 18:43 |
| java\/[0-9] | 2,510+1 | 939.32 KB | 31 Aug 2011 - 16:05 |
| VORTEX | 1,991 | 29.61 MB | 31 Aug 2011 - 20:40 |
| Speedy Spider | 1,476+226 | 15.62 MB | 31 Aug 2011 - 07:50 |
| Sogou Spider | 1,643+2 | 12.89 MB | 31 Aug 2011 - 23:58 |
| MJ12bot | 1,212+106 | 32.35 MB | 31 Aug 2011 - 12:18 |
| FaceBook bot | 1,224 | 16.99 MB | 31 Aug 2011 - 23:06 |
| Custo | 1,176+11 | 10.68 MB | 29 Aug 2011 - 23:25 |
| psbot | 1,116+39 | 7.06 MB | 18 Aug 2011 - 21:51 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1095 | 0 | 31 Aug 2011 - 23:27 |
| legs | 977+77 | 16.36 MB | 31 Aug 2011 - 23:03 |
| Motor | 891 | 12.65 MB | 28 Aug 2011 - 15:14 |
| Unknown robot (identified by 'discovery') | 574+244 | 4.14 MB | 31 Aug 2011 - 20:41 |
| Nutch | 571+67 | 10.29 MB | 31 Aug 2011 - 09:33 |
| Exabot | 347+31 | 3.16 MB | 31 Aug 2011 - 23:08 |
| Feedfetcher-Google | 286 | 2.25 MB | 31 Aug 2011 - 21:55 |
| WebCollage | 265 | 5.07 MB | 31 Aug 2011 - 22:30 |
| OutfoxBot/YodaoBot | 228 | 2.59 MB | 31 Aug 2011 - 22:25 |
| ichiro | 190+5 | 6.08 MB | 27 Aug 2011 - 23:54 |
| bender focused_crawler | 144+10 | 2.75 MB | 31 Aug 2011 - 19:28 |
| WordPress | 92 | 327.72 KB | 31 Aug 2011 - 16:29 |
| Alexa (IA Archiver) | 33+35 | 532.67 KB | 31 Aug 2011 - 09:19 |
| CFNetwork | 47 | 1.12 MB | 30 Aug 2011 - 21:04 |
| MSIECrawler | 34+7 | 344.39 KB | 22 Aug 2011 - 03:08 |
| BSpider | 20+16 | 150.94 KB | 31 Aug 2011 - 06:22 |
| Findlinks | 15+12 | 392.95 KB | 31 Aug 2011 - 18:45 |
| archive.org bot | 26+1 | 390.07 KB | 22 Aug 2011 - 07:59 |
| WGet tools | 25 | 57.37 KB | 27 Aug 2011 - 04:55 |
| Jakarta commons-httpclient | 14 | 233.55 KB | 26 Aug 2011 - 08:19 |
| Voila | 8+4 | 455.99 KB | 28 Aug 2011 - 15:52 |
| Python-urllib | 12 | 126.30 KB | 31 Aug 2011 - 15:37 |
| Perl tool | 10 | 108.56 KB | 26 Aug 2011 - 23:20 |
| GigaBot | 4+4 | 57.14 KB | 22 Aug 2011 - 22:45 |
| Powermarks | 5 | 148.67 KB | 28 Aug 2011 - 05:51 |
| larbin | 3+2 | 32.16 KB | 16 Aug 2011 - 14:38 |
| WallPaper (alias crawlpaper) | 4 | 68.02 KB | 21 Aug 2011 - 16:03 |
| Heritrix | 2+2 | 40.38 KB | 25 Aug 2011 - 07:22 |
| HTTrack off-line browser | 2+1 | 17.71 KB | 04 Aug 2011 - 06:57 |
| lwp-trivial | 3 | 48 Bytes | 27 Aug 2011 - 00:15 |
| XYLEME Robot | 3 | 6.67 KB | 26 Aug 2011 - 15:48 |
| Netcraft | 3 | 11.65 KB | 24 Aug 2011 - 20:13 |
| MojeekBot | 1+1 | 11.65 KB | 29 Aug 2011 - 12:04 |
| yacy | 1+1 | 64.85 KB | 08 Aug 2011 - 21:20 |
| MOMspider | 1+1 | 0 | 07 Aug 2011 - 19:40 |
| FavIconizer | 2 | 23.30 KB | 24 Aug 2011 - 06:42 |
| Unknown robot (identified by 'checker') | 2 | 0 | 30 Aug 2011 - 07:38 |
| Mail.ru bot | 1 | 5.86 KB | 05 Aug 2011 - 16:31 |
| Y!J Yahoo Japan | 0+1 | 0 | 17 Aug 2011 - 17:10 |
|