| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'spider') | 192,335+5 | 1.46 GB | 30 Apr 2011 - 23:59 |
| Googlebot | 76,775+67 | 965.42 MB | 30 Apr 2011 - 23:59 |
| Unknown robot (identified by 'bot*') | 59,829+1227 | 518.24 MB | 30 Apr 2011 - 23:59 |
| Yahoo Slurp | 53,104+146 | 582.89 MB | 30 Apr 2011 - 23:59 |
| Yandex bot | 51,870+107 | 636.61 MB | 30 Apr 2011 - 23:59 |
| MSNBot-media | 16,405+1243 | 313.78 MB | 30 Apr 2011 - 23:58 |
| Custo | 9,320+8 | 99.29 MB | 28 Apr 2011 - 15:57 |
| Unknown robot (identified by 'discovery') | 5,868+1168 | 51.51 MB | 30 Apr 2011 - 05:11 |
| Unknown robot (identified by 'robot') | 6,207+24 | 79.44 MB | 30 Apr 2011 - 05:19 |
| Unknown robot (identified by 'crawl') | 5,586+14 | 51.13 MB | 30 Apr 2011 - 23:59 |
| Exabot | 5,153+20 | 21.45 MB | 30 Apr 2011 - 17:23 |
| Heritrix | 3,427+6 | 45.39 MB | 22 Apr 2011 - 00:45 |
| WebCollage | 3,367 | 62.71 MB | 30 Apr 2011 - 23:59 |
| Motor | 3,325 | 47.89 MB | 30 Apr 2011 - 23:23 |
| MJ12bot | 2,123+74 | 46.37 MB | 30 Apr 2011 - 23:40 |
| Speedy Spider | 1,625+174 | 15.42 MB | 30 Apr 2011 - 21:02 |
| BaiDuSpider | 1,530+57 | 18.66 MB | 30 Apr 2011 - 23:33 |
| Unknown robot (identified by empty user agent string) | 1,105+111 | 13.85 MB | 30 Apr 2011 - 18:02 |
| Unknown robot (identified by '*bot') | 780+164 | 11.91 MB | 28 Apr 2011 - 17:50 |
| ichiro | 518+28 | 16.99 MB | 30 Apr 2011 - 23:45 |
| Unknown robot (identified by hit on 'robots.txt') | 0+505 | 0 | 30 Apr 2011 - 23:08 |
| FaceBook bot | 287+3 | 4.29 MB | 28 Apr 2011 - 14:22 |
| VORTEX | 244 | 3.21 MB | 26 Apr 2011 - 11:52 |
| WGet tools | 238 | 1.57 MB | 26 Apr 2011 - 14:40 |
| Feedfetcher-Google | 231 | 2.00 MB | 30 Apr 2011 - 21:54 |
| OutfoxBot/YodaoBot | 209 | 2.38 MB | 30 Apr 2011 - 22:38 |
| bender focused_crawler | 146+16 | 3.29 MB | 30 Apr 2011 - 23:56 |
| Sogou Spider | 128+12 | 5.57 MB | 30 Apr 2011 - 08:03 |
| TITAN | 106 | 1.37 MB | 13 Apr 2011 - 22:46 |
| Alexa (IA Archiver) | 63+23 | 925.05 KB | 30 Apr 2011 - 05:35 |
| Nutch | 62+14 | 827.25 KB | 30 Apr 2011 - 14:31 |
| Python-urllib | 68 | 52.86 KB | 16 Apr 2011 - 05:48 |
| CFNetwork | 28 | 702.04 KB | 29 Apr 2011 - 14:45 |
| Monster | 22 | 247.57 KB | 02 Apr 2011 - 13:30 |
| BSpider | 15+6 | 162.97 KB | 30 Apr 2011 - 16:41 |
| Findlinks | 12+9 | 259.82 KB | 29 Apr 2011 - 15:39 |
| Web Core / Roots | 20 | 1023.63 KB | 18 Apr 2011 - 09:06 |
| Perl tool | 12 | 49.68 KB | 30 Apr 2011 - 05:08 |
| legs | 4+7 | 25.11 KB | 09 Apr 2011 - 02:34 |
| WordPress | 11 | 70.11 KB | 29 Apr 2011 - 01:07 |
| java\/[0-9] | 9 | 79.58 KB | 23 Apr 2011 - 03:05 |
| Voila | 5+3 | 285.00 KB | 27 Apr 2011 - 00:24 |
| GigaBot | 3+3 | 34.96 KB | 27 Apr 2011 - 04:47 |
| Mail.ru bot | 3+2 | 19.20 KB | 28 Apr 2011 - 06:34 |
| Jakarta commons-httpclient | 4 | 44.41 KB | 18 Apr 2011 - 02:54 |
| WallPaper (alias crawlpaper) | 4 | 36.77 KB | 18 Apr 2011 - 17:01 |
| larbin | 2+2 | 23.30 KB | 30 Apr 2011 - 15:59 |
| Netcraft | 3 | 11.65 KB | 28 Apr 2011 - 12:01 |
| The web archive (IA Archiver) | 0+2 | 0 | 27 Apr 2011 - 23:13 |
| Vagabondo | 1+1 | 25 Bytes | 19 Apr 2011 - 13:13 |
| HTMLParser | 2 | 17.71 KB | 16 Apr 2011 - 13:40 |
| Y!J Yahoo Japan | 1+1 | 6.85 KB | 17 Apr 2011 - 20:58 |
| MOMspider | 1+1 | 0 | 25 Apr 2011 - 04:04 |
| yacy | 1+1 | 8.85 KB | 15 Apr 2011 - 23:06 |
| HTTrack off-line browser | 2 | 73.71 KB | 14 Apr 2011 - 08:02 |
| FavIconizer | 2 | 23.30 KB | 23 Apr 2011 - 00:45 |
| EasyDL | 1 | 11.65 KB | 16 Apr 2011 - 13:02 |
| Digger | 1 | 8.85 KB | 25 Apr 2011 - 18:54 |
| MSIECrawler | 1 | 23.97 KB | 07 Apr 2011 - 07:35 |
|