56 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 2,561,834+438 | 469.78 GB | 30 Apr 2013 - 23:59 |
HTTrack off-line browser | 1,327,452+11 | 18.40 GB | 30 Apr 2013 - 02:00 |
BaiDuSpider | 284,742 | 49.98 GB | 30 Apr 2013 - 23:59 |
Googlebot | 199,106+67 | 2.41 GB | 30 Apr 2013 - 23:59 |
MSNBot-media | 61,310+21841 | 1.29 GB | 30 Apr 2013 - 23:57 |
Unknown robot (identified by 'spider') | 40,325+56 | 337.97 MB | 30 Apr 2013 - 23:39 |
Unknown robot (identified by '*bot') | 24,811+416 | 265.11 MB | 30 Apr 2013 - 23:58 |
Yandex bot | 23,234+100 | 283.48 MB | 30 Apr 2013 - 23:58 |
WebCollage | 22,069 | 476.69 MB | 30 Apr 2013 - 23:58 |
Yahoo Slurp | 14,522+111 | 156.39 MB | 30 Apr 2013 - 23:58 |
Unknown robot (identified by 'robot') | 10,265+39 | 99.07 MB | 30 Apr 2013 - 23:57 |
Unknown robot (identified by 'crawl') | 10,106+30 | 130.64 MB | 30 Apr 2013 - 16:28 |
MSNBot | 8,188+52 | 389.72 MB | 30 Apr 2013 - 13:51 |
Sogou Spider | 6,343+46 | 65.25 MB | 30 Apr 2013 - 22:36 |
Unknown robot (identified by empty user agent string) | 4,878+2 | 93.03 MB | 30 Apr 2013 - 21:04 |
Custo | 3,907+1 | 33.87 MB | 27 Apr 2013 - 18:27 |
Unknown robot (identified by 'discovery') | 3,097+10 | 36.10 MB | 30 Apr 2013 - 22:24 |
Exabot | 2,616+60 | 16.84 MB | 30 Apr 2013 - 22:35 |
MJ12bot | 1,733+112 | 40.07 MB | 30 Apr 2013 - 13:49 |
Mail.ru bot | 1,132+11 | 15.80 MB | 30 Apr 2013 - 23:15 |
Unknown robot (identified by hit on 'robots.txt') | 0+760 | 0 | 30 Apr 2013 - 22:54 |
CFNetwork | 758 | 15.12 MB | 30 Apr 2013 - 23:58 |
Feedfetcher-Google | 482 | 2.96 MB | 30 Apr 2013 - 23:59 |
Python-urllib | 411+14 | 6.26 MB | 30 Apr 2013 - 12:40 |
BSpider | 411+10 | 25.94 MB | 30 Apr 2013 - 23:12 |
Perl tool | 340 | 4.34 MB | 15 Apr 2013 - 15:47 |
Alexa (IA Archiver) | 187+86 | 2.65 MB | 30 Apr 2013 - 13:20 |
java\/[0-9] | 250 | 823.28 KB | 29 Apr 2013 - 17:25 |
SeznamBot | 238+10 | 6.32 MB | 28 Apr 2013 - 20:43 |
Y!J Yahoo Japan | 102+102 | 692.04 KB | 30 Apr 2013 - 03:33 |
Web Core / Roots | 127 | 2.40 MB | 23 Apr 2013 - 07:03 |
ichiro | 105+22 | 3.86 MB | 30 Apr 2013 - 15:04 |
FaceBook bot | 109+4 | 3.50 MB | 30 Apr 2013 - 21:56 |
psbot | 77+21 | 1.37 MB | 23 Apr 2013 - 23:36 |
Nutch | 64+32 | 1.43 MB | 28 Apr 2013 - 09:41 |
OutfoxBot/YodaoBot | 63 | 734.10 KB | 23 Apr 2013 - 15:38 |
Phantom | 55 | 468.17 KB | 07 Apr 2013 - 01:25 |
Motor | 52 | 382.95 KB | 19 Apr 2013 - 08:42 |
archive.org bot | 46+6 | 3.88 MB | 10 Apr 2013 - 10:29 |
legs | 12+25 | 122.69 KB | 29 Apr 2013 - 13:32 |
WebFilter | 29+6 | 480.94 KB | 28 Apr 2013 - 08:34 |
larbin | 19+3 | 604.24 KB | 25 Apr 2013 - 05:53 |
WGet tools | 21 | 71.43 KB | 22 Apr 2013 - 19:57 |
Jakarta commons-httpclient | 20 | 1.89 MB | 29 Apr 2013 - 16:58 |
WordPress | 17 | 90.61 KB | 28 Apr 2013 - 14:50 |
Google AdSense | 7 | 103.88 KB | 24 Apr 2013 - 20:29 |
FavIconizer | 6 | 69.91 KB | 23 Apr 2013 - 22:00 |
NG 1.x (Exalead) | 5 | 134.24 KB | 24 Apr 2013 - 00:10 |
Voila | 1+4 | 57.00 KB | 24 Apr 2013 - 20:53 |
WallPaper (alias crawlpaper) | 3 | 45.74 KB | 23 Apr 2013 - 23:38 |
Netcraft | 3 | 11.65 KB | 10 Apr 2013 - 08:14 |
MOMspider | 1+1 | 0 | 08 Apr 2013 - 02:53 |
Unknown robot (identified by 'checker') | 2 | 0 | 19 Apr 2013 - 01:32 |
MojeekBot | 0+1 | 0 | 17 Apr 2013 - 20:01 |
yacy | 1 | 11.65 KB | 04 Apr 2013 - 11:42 |
XYLEME Robot | 1 | 14.67 KB | 13 Apr 2013 - 05:48 |
|