| 55 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 41,932+512 | 568.35 MB | 30 Jun 2011 - 23:59 |
| Yandex bot | 88,442+102 | 417.53 MB | 30 Jun 2011 - 23:59 |
| Yahoo Slurp | 53,115+132 | 632.47 MB | 30 Jun 2011 - 23:59 |
| Unknown robot (identified by 'robot') | 12,988+43 | 102.12 MB | 30 Jun 2011 - 23:58 |
| MSNBot-media | 20,073+1663 | 374.92 MB | 30 Jun 2011 - 23:57 |
| Googlebot | 70,243+79 | 827.62 MB | 30 Jun 2011 - 23:54 |
| Unknown robot (identified by empty user agent string) | 1,290+104 | 13.34 MB | 30 Jun 2011 - 23:51 |
| Unknown robot (identified by hit on 'robots.txt') | 0+423 | 0 | 30 Jun 2011 - 23:49 |
| Alexa (IA Archiver) | 48+40 | 884.77 KB | 30 Jun 2011 - 23:40 |
| Unknown robot (identified by '*bot') | 5,078+281 | 42.90 MB | 30 Jun 2011 - 23:35 |
| Speedy Spider | 2,235+312 | 28.52 MB | 30 Jun 2011 - 23:33 |
| BaiDuSpider | 1,417+18 | 17.39 MB | 30 Jun 2011 - 23:32 |
| Feedfetcher-Google | 236 | 2.04 MB | 30 Jun 2011 - 23:21 |
| Unknown robot (identified by 'spider') | 201,165+12 | 1.37 GB | 30 Jun 2011 - 23:20 |
| Findlinks | 17+11 | 289.65 KB | 30 Jun 2011 - 23:20 |
| Nutch | 804+53 | 15.47 MB | 30 Jun 2011 - 23:19 |
| MJ12bot | 2,265+95 | 58.41 MB | 30 Jun 2011 - 22:50 |
| Exabot | 231+30 | 1.93 MB | 30 Jun 2011 - 22:43 |
| OutfoxBot/YodaoBot | 321 | 3.65 MB | 30 Jun 2011 - 22:38 |
| Unknown robot (identified by 'crawl') | 6,337+105 | 69.79 MB | 30 Jun 2011 - 21:49 |
| CFNetwork | 48 | 1.53 MB | 30 Jun 2011 - 21:27 |
| BSpider | 9+26 | 115.23 KB | 30 Jun 2011 - 20:39 |
| WebCollage | 16 | 328.26 KB | 30 Jun 2011 - 19:57 |
| Custo | 1,539+8 | 17.58 MB | 30 Jun 2011 - 19:32 |
| gammaSpider, FocusedCrawler | 10 | 168.22 KB | 30 Jun 2011 - 18:49 |
| FaceBook bot | 254 | 3.47 MB | 30 Jun 2011 - 16:05 |
| Motor | 4,046 | 56.05 MB | 30 Jun 2011 - 14:33 |
| Unknown robot (identified by 'discovery') | 2,821+10 | 16.40 MB | 30 Jun 2011 - 13:34 |
| ichiro | 62+6 | 1.83 MB | 30 Jun 2011 - 12:56 |
| Sogou Spider | 160+2 | 3.91 MB | 30 Jun 2011 - 11:18 |
| bender focused_crawler | 518+90 | 13.11 MB | 30 Jun 2011 - 09:53 |
| Netcraft | 7 | 11.65 KB | 30 Jun 2011 - 06:47 |
| Voila | 9+4 | 512.99 KB | 30 Jun 2011 - 00:37 |
| Mail.ru bot | 4+1 | 42.66 KB | 29 Jun 2011 - 10:06 |
| Web Core / Roots | 62 | 1.21 MB | 29 Jun 2011 - 08:53 |
| GigaBot | 3+3 | 34.96 KB | 28 Jun 2011 - 22:02 |
| larbin | 3+5 | 34.96 KB | 28 Jun 2011 - 21:47 |
| VORTEX | 116 | 1.35 MB | 28 Jun 2011 - 18:29 |
| yacy | 1+1 | 8.85 KB | 28 Jun 2011 - 08:55 |
| java\/[0-9] | 5+1 | 45.73 KB | 27 Jun 2011 - 15:24 |
| WordPress | 80 | 440.54 KB | 27 Jun 2011 - 08:16 |
| psbot | 809+37 | 5.24 MB | 27 Jun 2011 - 04:23 |
| legs | 7+8 | 54.92 KB | 26 Jun 2011 - 20:37 |
| EasyDL | 4 | 46.61 KB | 26 Jun 2011 - 06:44 |
| JCrawler | 1+1 | 8.85 KB | 26 Jun 2011 - 06:28 |
| Jakarta commons-httpclient | 2 | 14.77 KB | 26 Jun 2011 - 00:03 |
| Python-urllib | 113 | 2.91 MB | 23 Jun 2011 - 00:47 |
| Powermarks | 6 | 210.47 KB | 21 Jun 2011 - 21:39 |
| WGet tools | 12 | 272.63 KB | 21 Jun 2011 - 17:53 |
| Ask | 9+6 | 327.42 KB | 20 Jun 2011 - 15:23 |
| Perl tool | 7 | 4.90 KB | 17 Jun 2011 - 02:23 |
| Turn It In | 57+1 | 1.33 MB | 10 Jun 2011 - 21:59 |
| MOMspider | 1+1 | 0 | 09 Jun 2011 - 17:10 |
| archive.org bot | 2,983+1 | 50.10 MB | 09 Jun 2011 - 15:40 |
| Heritrix | 1+1 | 25.38 KB | 06 Jun 2011 - 09:06 |
|