| 67 different robots | Hits | Bandwidth | Last visit |
|---|
| HTTrack off-line browser | 99,608+5 | 1.41 GB | 25 Aug 2012 - 05:40 |
| Googlebot | 91,879+75 | 1.12 GB | 31 Aug 2012 - 23:59 |
| Unknown robot (identified by 'bot*') | 62,892+911 | 774.79 MB | 31 Aug 2012 - 23:58 |
| BaiDuSpider | 63,438+135 | 1.86 GB | 31 Aug 2012 - 23:59 |
| MSNBot-media | 30,098+3726 | 643.41 MB | 31 Aug 2012 - 18:21 |
| MSNBot | 30,419+32 | 548.01 MB | 31 Aug 2012 - 10:30 |
| Unknown robot (identified by 'robot') | 26,872+41 | 275.61 MB | 30 Aug 2012 - 21:09 |
| Unknown robot (identified by '*bot') | 22,945+321 | 223.43 MB | 31 Aug 2012 - 21:58 |
| Yandex bot | 21,351+72 | 302.51 MB | 31 Aug 2012 - 23:59 |
| Unknown robot (identified by 'crawl') | 15,931+50 | 158.35 MB | 31 Aug 2012 - 21:06 |
| Yahoo Slurp | 15,267+117 | 156.32 MB | 31 Aug 2012 - 23:47 |
| Unknown robot (identified by 'spider') | 10,786+35 | 118.03 MB | 31 Aug 2012 - 22:06 |
| Sogou Spider | 9,793+10 | 78.31 MB | 31 Aug 2012 - 23:58 |
| FaceBook bot | 4,407 | 85.66 MB | 31 Aug 2012 - 23:52 |
| WebCollage | 3,105 | 88.03 MB | 31 Aug 2012 - 23:58 |
| psbot | 1,672+207 | 31.35 MB | 31 Aug 2012 - 23:29 |
| MJ12bot | 1,553+83 | 32.97 MB | 31 Aug 2012 - 09:07 |
| Unknown robot (identified by empty user agent string) | 1,582+19 | 18.97 MB | 31 Aug 2012 - 22:36 |
| java\/[0-9] | 1,338+9 | 18.48 MB | 31 Aug 2012 - 09:17 |
| Exabot | 865+25 | 7.02 MB | 31 Aug 2012 - 17:42 |
| Unknown robot (identified by hit on 'robots.txt') | 0+875 | 0 | 31 Aug 2012 - 17:03 |
| SeznamBot | 674+18 | 9.60 MB | 31 Aug 2012 - 09:42 |
| BSpider | 618+24 | 4.79 MB | 31 Aug 2012 - 19:49 |
| Feedfetcher-Google | 501 | 3.07 MB | 31 Aug 2012 - 23:41 |
| CFNetwork | 433 | 7.98 MB | 31 Aug 2012 - 22:00 |
| Custo | 338 | 3.06 MB | 31 Aug 2012 - 20:32 |
| Alexa (IA Archiver) | 214+105 | 6.12 MB | 31 Aug 2012 - 21:23 |
| archive.org bot | 294+6 | 4.87 MB | 31 Aug 2012 - 10:40 |
| OutfoxBot/YodaoBot | 204 | 2.32 MB | 31 Aug 2012 - 20:14 |
| ichiro | 170+28 | 5.32 MB | 31 Aug 2012 - 11:33 |
| bender focused_crawler | 154+3 | 7.26 MB | 04 Aug 2012 - 12:33 |
| WordPress | 144 | 652.29 KB | 30 Aug 2012 - 15:47 |
| Nutch | 103+18 | 3.09 MB | 31 Aug 2012 - 22:43 |
| Mail.ru bot | 68+6 | 911.49 KB | 31 Aug 2012 - 14:59 |
| WGet tools | 64 | 831.55 KB | 31 Aug 2012 - 09:32 |
| Powermarks | 59 | 2.43 MB | 09 Aug 2012 - 07:46 |
| Unknown robot (identified by 'discovery') | 50+2 | 53.28 KB | 31 Aug 2012 - 23:12 |
| QihooBot | 45 | 43.22 KB | 09 Aug 2012 - 19:11 |
| Motor | 44 | 2.08 MB | 24 Aug 2012 - 12:45 |
| WebFilter | 44 | 2.46 MB | 31 Aug 2012 - 22:39 |
| LinkChecker | 38+5 | 1.02 MB | 16 Aug 2012 - 20:35 |
| Python-urllib | 9+28 | 59.16 KB | 30 Aug 2012 - 23:36 |
| Web Core / Roots | 28 | 277.19 KB | 20 Aug 2012 - 16:27 |
| Y!J Yahoo Japan | 14+9 | 333.24 KB | 27 Aug 2012 - 18:49 |
| Phantom | 22 | 187.27 KB | 24 Aug 2012 - 01:44 |
| Sunrise | 21 | 257.65 KB | 14 Aug 2012 - 10:07 |
| Findlinks | 9+5 | 101.01 KB | 28 Aug 2012 - 17:03 |
| Voila | 6+6 | 293.42 KB | 29 Aug 2012 - 22:49 |
| W3C Link Checker | 6+6 | 0 | 26 Aug 2012 - 10:10 |
| Perl tool | 9+1 | 20.62 KB | 28 Aug 2012 - 21:49 |
| Turn It In | 4+5 | 32.36 KB | 25 Aug 2012 - 14:32 |
| Google AdSense | 5 | 221.21 KB | 09 Aug 2012 - 10:56 |
| FavIconizer | 4 | 46.61 KB | 23 Aug 2012 - 03:40 |
| HTMLParser | 4 | 2.53 MB | 31 Aug 2012 - 08:59 |
| StackRambler | 3 | 28.89 KB | 01 Aug 2012 - 11:53 |
| Netcraft | 3 | 11.65 KB | 06 Aug 2012 - 10:04 |
| NG 1.x (Exalead) | 3 | 34.11 KB | 30 Aug 2012 - 20:39 |
| W3C Validator | 2 | 20.35 KB | 15 Aug 2012 - 10:35 |
| Heritrix | 1+1 | 6.42 KB | 31 Aug 2012 - 05:18 |
| Harvest | 0+2 | 0 | 06 Aug 2012 - 10:04 |
| Unknown robot (identified by 'checker') | 2 | 0 | 28 Aug 2012 - 12:40 |
| WallPaper (alias crawlpaper) | 2 | 53.27 KB | 18 Aug 2012 - 10:39 |
| MOMspider | 1+1 | 0 | 07 Aug 2012 - 18:16 |
| MSRBOT | 1+1 | 6.67 KB | 01 Aug 2012 - 05:25 |
| VORTEX | 2 | 17.60 KB | 26 Aug 2012 - 16:38 |
| InfoSeek Robot 1.0 | 1 | 16 Bytes | 30 Aug 2012 - 08:54 |
| Jakarta commons-httpclient | 1 | 13.97 KB | 31 Aug 2012 - 21:17 |
|