| 57 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot*') | 3,754,433+1116 | 799.36 GB | 31 Dec 2013 - 23:59 |
| MSNBot-media | 197,007+42218 | 3.42 GB | 31 Dec 2013 - 23:59 |
| Googlebot | 175,679+60 | 1.68 GB | 31 Dec 2013 - 23:59 |
| Yandex bot | 53,818+81 | 249.05 MB | 31 Dec 2013 - 23:50 |
| Unknown robot (identified by 'robot') | 31,539+17 | 375.00 MB | 31 Dec 2013 - 23:59 |
| BaiDuSpider | 24,243+14 | 622.14 MB | 31 Dec 2013 - 23:48 |
| Unknown robot (identified by 'spider') | 18,808+68 | 175.41 MB | 31 Dec 2013 - 23:50 |
| Yahoo Slurp | 16,485+14 | 176.60 MB | 31 Dec 2013 - 21:06 |
| Custo | 10,508 | 92.43 MB | 31 Dec 2013 - 21:56 |
| Sogou Spider | 10,145+68 | 173.58 MB | 31 Dec 2013 - 14:34 |
| Turn It In | 6,929+17 | 46.68 MB | 28 Dec 2013 - 20:44 |
| Unknown robot (identified by empty user agent string) | 3,543+2 | 62.53 MB | 31 Dec 2013 - 23:54 |
| archive.org bot | 3,111+54 | 49.36 MB | 31 Dec 2013 - 13:59 |
| Unknown robot (identified by '*bot') | 2,231+39 | 28.46 MB | 27 Dec 2013 - 04:23 |
| MSNBot | 2,134+78 | 96.30 MB | 31 Dec 2013 - 21:34 |
| psbot | 2,058+98 | 19.03 MB | 31 Dec 2013 - 23:56 |
| Mail.ru bot | 1,716+297 | 17.57 MB | 31 Dec 2013 - 23:24 |
| Exabot | 1,767+43 | 15.86 MB | 31 Dec 2013 - 23:54 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1168 | 0 | 31 Dec 2013 - 23:41 |
| MJ12bot | 716+144 | 25.44 MB | 31 Dec 2013 - 22:50 |
| WebCollage | 491 | 13.34 MB | 31 Dec 2013 - 23:53 |
| Feedfetcher-Google | 457 | 2.87 MB | 31 Dec 2013 - 22:23 |
| Alexa (IA Archiver) | 226+72 | 4.81 MB | 31 Dec 2013 - 14:44 |
| SeznamBot | 249+17 | 6.17 MB | 31 Dec 2013 - 08:34 |
| NG 1.x (Exalead) | 198 | 27.93 MB | 31 Dec 2013 - 21:48 |
| Unknown robot (identified by 'crawl') | 165+17 | 3.58 MB | 31 Dec 2013 - 23:11 |
| WordPress | 168 | 2.09 MB | 31 Dec 2013 - 17:02 |
| WebFilter | 113+13 | 4.34 MB | 31 Dec 2013 - 00:52 |
| Perl tool | 121 | 1018.61 KB | 31 Dec 2013 - 22:01 |
| Unknown robot (identified by 'discovery') | 98 | 38.11 KB | 29 Dec 2013 - 04:37 |
| MojeekBot | 49+41 | 600.51 KB | 31 Dec 2013 - 23:14 |
| FavIconizer | 82 | 955.49 KB | 31 Dec 2013 - 05:47 |
| java\/[0-9] | 78 | 2.91 MB | 31 Dec 2013 - 15:14 |
| VORTEX | 78 | 1.04 MB | 27 Dec 2013 - 07:46 |
| XYLEME Robot | 77 | 945.80 KB | 22 Dec 2013 - 12:27 |
| Python-urllib | 55+17 | 8.26 MB | 31 Dec 2013 - 21:41 |
| TITAN | 66 | 855.26 KB | 03 Dec 2013 - 07:27 |
| CFNetwork | 62+1 | 1.48 MB | 30 Dec 2013 - 22:03 |
| Nutch | 38+17 | 433.01 KB | 28 Dec 2013 - 18:16 |
| Google AdSense | 50 | 449.26 KB | 31 Dec 2013 - 19:51 |
| legs | 22+21 | 176.19 KB | 29 Dec 2013 - 17:41 |
| FaceBook bot | 40 | 432.18 KB | 31 Dec 2013 - 22:43 |
| ichiro | 23+9 | 1.94 MB | 30 Dec 2013 - 21:48 |
| Motor | 13+1 | 160.62 KB | 11 Dec 2013 - 21:54 |
| Jakarta commons-httpclient | 7+6 | 72.62 KB | 30 Dec 2013 - 16:06 |
| Web Core / Roots | 8 | 3.68 MB | 26 Dec 2013 - 16:57 |
| Unknown robot (identified by 'checker') | 8 | 43.78 KB | 28 Dec 2013 - 11:49 |
| WallPaper (alias crawlpaper) | 7 | 103.57 KB | 31 Dec 2013 - 23:41 |
| Voila | 3+3 | 171.00 KB | 29 Dec 2013 - 11:53 |
| WGet tools | 5 | 28.50 KB | 06 Dec 2013 - 23:21 |
| HTTrack off-line browser | 5 | 54.00 KB | 17 Dec 2013 - 21:48 |
| Netcraft | 4 | 23.30 KB | 10 Dec 2013 - 14:58 |
| Unknown robot (identified by 'sucker') | 1+1 | 30.82 KB | 30 Dec 2013 - 11:04 |
| W3C Link Checker | 1+1 | 0 | 22 Dec 2013 - 04:55 |
| MOMspider | 1+1 | 0 | 08 Dec 2013 - 09:25 |
| yacy | 0+1 | 0 | 10 Dec 2013 - 06:06 |
| Pioneer | 1 | 13.16 KB | 27 Dec 2013 - 18:04 |
|