| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 55,999+91 | 594.67 MB | 31 Oct 2011 - 22:45 |
| Googlebot | 52,246+79 | 828.52 MB | 31 Oct 2011 - 23:57 |
| BaiDuSpider | 40,969+61 | 415.90 MB | 31 Oct 2011 - 23:59 |
| Unknown robot (identified by 'bot*') | 34,434+1278 | 541.36 MB | 31 Oct 2011 - 23:58 |
| Unknown robot (identified by 'robot') | 20,465+77 | 201.40 MB | 31 Oct 2011 - 21:56 |
| Yandex bot | 13,341+76 | 155.63 MB | 31 Oct 2011 - 23:58 |
| MSNBot-media | 6,929+1837 | 126.42 MB | 31 Oct 2011 - 23:59 |
| Sogou Spider | 8,197+7 | 59.84 MB | 31 Oct 2011 - 23:58 |
| Custo | 5,568+9 | 44.98 MB | 26 Oct 2011 - 16:06 |
| Unknown robot (identified by 'crawl') | 4,741+20 | 43.32 MB | 31 Oct 2011 - 20:45 |
| Speedy Spider | 2,218+256 | 27.42 MB | 31 Oct 2011 - 23:18 |
| Unknown robot (identified by '*bot') | 1,981+205 | 17.93 MB | 31 Oct 2011 - 22:52 |
| MJ12bot | 1,536+120 | 42.25 MB | 31 Oct 2011 - 18:08 |
| Unknown robot (identified by 'spider') | 1,241+28 | 7.83 MB | 30 Oct 2011 - 23:37 |
| Feedfetcher-Google | 1,246 | 4.07 MB | 31 Oct 2011 - 23:39 |
| Nutch | 1,044+54 | 10.25 MB | 31 Oct 2011 - 23:55 |
| Unknown robot (identified by empty user agent string) | 908+6 | 10.07 MB | 31 Oct 2011 - 06:28 |
| psbot | 763+22 | 8.63 MB | 25 Oct 2011 - 07:26 |
| FaceBook bot | 780 | 8.66 MB | 31 Oct 2011 - 20:16 |
| Turn It In | 650+2 | 7.84 MB | 16 Oct 2011 - 09:29 |
| Unknown robot (identified by hit on 'robots.txt') | 0+634 | 0 | 31 Oct 2011 - 22:35 |
| WebCollage | 614 | 12.04 MB | 31 Oct 2011 - 21:51 |
| bender focused_crawler | 280+6 | 16.02 MB | 31 Oct 2011 - 18:09 |
| Exabot | 256+16 | 1.74 MB | 23 Oct 2011 - 15:28 |
| OutfoxBot/YodaoBot | 221+2 | 2.49 MB | 31 Oct 2011 - 20:14 |
| Alexa (IA Archiver) | 102+72 | 1.25 MB | 31 Oct 2011 - 19:17 |
| legs | 106+49 | 1.54 MB | 29 Oct 2011 - 00:00 |
| Unknown robot (identified by 'discovery') | 104 | 1.10 MB | 31 Oct 2011 - 09:08 |
| WGet tools | 93 | 800.35 KB | 31 Oct 2011 - 23:50 |
| WordPress | 76 | 58.28 KB | 31 Oct 2011 - 01:38 |
| ichiro | 59+13 | 1.91 MB | 29 Oct 2011 - 01:46 |
| MSNBot | 38+2 | 1.15 MB | 31 Oct 2011 - 17:46 |
| BSpider | 21+19 | 221.29 KB | 31 Oct 2011 - 23:59 |
| SeznamBot | 21+13 | 5.46 MB | 31 Oct 2011 - 14:40 |
| CFNetwork | 34 | 751.92 KB | 31 Oct 2011 - 21:09 |
| Perl tool | 34 | 370.08 KB | 31 Oct 2011 - 20:44 |
| Findlinks | 14+14 | 149.35 KB | 31 Oct 2011 - 22:02 |
| MojeekBot | 15+9 | 271.96 KB | 13 Oct 2011 - 01:24 |
| NG 1.x (Exalead) | 23 | 302.10 KB | 05 Oct 2011 - 10:51 |
| Jakarta commons-httpclient | 22 | 560.92 KB | 30 Oct 2011 - 14:30 |
| java\/[0-9] | 19 | 197.97 KB | 31 Oct 2011 - 04:53 |
| GigaBot | 8+8 | 93.22 KB | 28 Oct 2011 - 23:18 |
| Voila | 10+5 | 569.99 KB | 29 Oct 2011 - 22:50 |
| VORTEX | 11 | 111.06 KB | 29 Oct 2011 - 13:22 |
| WallPaper (alias crawlpaper) | 9 | 194.61 KB | 28 Oct 2011 - 20:27 |
| Heritrix | 8+1 | 67.56 KB | 15 Oct 2011 - 01:57 |
| Netcraft | 9 | 11.65 KB | 28 Oct 2011 - 18:45 |
| Mail.ru bot | 7 | 74.33 KB | 28 Oct 2011 - 19:50 |
| Unknown robot (identified by 'hunter') | 4 | 68.62 KB | 07 Oct 2011 - 03:39 |
| FavIconizer | 4 | 46.61 KB | 30 Oct 2011 - 10:14 |
| larbin | 2+1 | 20.50 KB | 30 Oct 2011 - 19:43 |
| Powermarks | 2 | 40.82 KB | 23 Oct 2011 - 14:19 |
| MOMspider | 1+1 | 0 | 07 Oct 2011 - 14:01 |
| yacy | 1+1 | 64.88 KB | 31 Oct 2011 - 05:19 |
| Unknown robot (identified by 'checker') | 2 | 0 | 28 Oct 2011 - 08:48 |
| HTMLParser | 1 | 8.85 KB | 28 Oct 2011 - 22:27 |
| Motor | 1 | 18.03 KB | 03 Oct 2011 - 16:56 |
| Python-urllib | 1 | 8.85 KB | 06 Oct 2011 - 07:15 |
| MSIECrawler | 1 | 8.85 KB | 03 Oct 2011 - 12:51 |
|