59 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 152,024+624 | 2.01 GB | 31 Dec 2012 - 23:59 |
WGet tools | 140,534+1 | 2.73 GB | 31 Dec 2012 - 17:49 |
Googlebot | 113,546+75 | 1.53 GB | 31 Dec 2012 - 23:58 |
MSNBot-media | 77,574+13276 | 1.61 GB | 31 Dec 2012 - 23:59 |
BaiDuSpider | 41,044+12 | 639.27 MB | 31 Dec 2012 - 23:59 |
Unknown robot (identified by '*bot') | 28,954+402 | 273.55 MB | 31 Dec 2012 - 23:04 |
Unknown robot (identified by 'robot') | 28,677+35 | 273.94 MB | 31 Dec 2012 - 23:55 |
Yandex bot | 26,970+96 | 398.07 MB | 31 Dec 2012 - 23:57 |
Unknown robot (identified by 'crawl') | 26,954+78 | 292.73 MB | 31 Dec 2012 - 23:59 |
Unknown robot (identified by 'spider') | 21,024+81 | 188.04 MB | 31 Dec 2012 - 23:26 |
Yahoo Slurp | 17,677+123 | 191.28 MB | 31 Dec 2012 - 23:18 |
MSNBot | 14,330+62 | 362.74 MB | 31 Dec 2012 - 16:57 |
WebCollage | 12,786 | 310.28 MB | 31 Dec 2012 - 23:58 |
Sogou Spider | 8,138+45 | 68.17 MB | 31 Dec 2012 - 23:59 |
Unknown robot (identified by empty user agent string) | 2,467+64 | 33.34 MB | 31 Dec 2012 - 23:59 |
psbot | 1,798+63 | 32.12 MB | 29 Dec 2012 - 17:44 |
BSpider | 1,210+40 | 19.22 MB | 31 Dec 2012 - 23:37 |
MJ12bot | 1,129+84 | 28.06 MB | 31 Dec 2012 - 17:47 |
Exabot | 822+60 | 7.34 MB | 31 Dec 2012 - 23:57 |
Nutch | 766+53 | 23.26 MB | 30 Dec 2012 - 01:07 |
Unknown robot (identified by hit on 'robots.txt') | 0+782 | 0 | 31 Dec 2012 - 23:20 |
CFNetwork | 591 | 10.95 MB | 31 Dec 2012 - 20:30 |
Feedfetcher-Google | 498 | 3.23 MB | 31 Dec 2012 - 23:50 |
Alexa (IA Archiver) | 329+80 | 9.39 MB | 31 Dec 2012 - 18:09 |
Mail.ru bot | 319+14 | 4.75 MB | 31 Dec 2012 - 21:29 |
SeznamBot | 308+20 | 7.34 MB | 31 Dec 2012 - 09:23 |
java\/[0-9] | 280+1 | 13.54 MB | 30 Dec 2012 - 07:31 |
ichiro | 192+30 | 5.83 MB | 31 Dec 2012 - 20:25 |
OutfoxBot/YodaoBot | 214 | 2.44 MB | 31 Dec 2012 - 23:07 |
FaceBook bot | 167 | 4.53 MB | 28 Dec 2012 - 22:15 |
Unknown robot (identified by 'discovery') | 128 | 0 | 30 Dec 2012 - 17:09 |
WordPress | 78 | 5.75 MB | 29 Dec 2012 - 11:15 |
WebFilter | 59+9 | 4.03 MB | 31 Dec 2012 - 12:04 |
Y!J Yahoo Japan | 33+33 | 246.81 KB | 30 Dec 2012 - 09:44 |
Phantom | 45 | 303.91 KB | 25 Dec 2012 - 15:55 |
VORTEX | 36 | 397.38 KB | 19 Dec 2012 - 13:32 |
Custo | 34 | 504.83 KB | 27 Dec 2012 - 13:50 |
Web Core / Roots | 25+5 | 5.90 MB | 28 Dec 2012 - 17:56 |
Turn It In | 19+4 | 1.02 MB | 14 Dec 2012 - 07:35 |
Perl tool | 11 | 28.79 KB | 08 Dec 2012 - 13:31 |
WallPaper (alias crawlpaper) | 9 | 162.78 KB | 21 Dec 2012 - 22:13 |
NG 1.x (Exalead) | 9 | 67.16 KB | 31 Dec 2012 - 07:23 |
Voila | 2+6 | 114.00 KB | 24 Dec 2012 - 04:11 |
StackRambler | 6 | 480.75 KB | 06 Dec 2012 - 02:16 |
Jakarta commons-httpclient | 5 | 58.26 KB | 31 Dec 2012 - 16:30 |
Python-urllib | 4+1 | 99.38 KB | 30 Dec 2012 - 09:47 |
Google AdSense | 3 | 21.87 KB | 29 Dec 2012 - 09:44 |
yacy | 0+3 | 0 | 29 Dec 2012 - 11:49 |
Findlinks | 1+2 | 11.65 KB | 26 Dec 2012 - 15:00 |
Heritrix | 2+1 | 49.08 KB | 03 Dec 2012 - 14:16 |
Unknown robot (identified by 'checker') | 3 | 0 | 26 Dec 2012 - 16:03 |
Netcraft | 3 | 11.65 KB | 05 Dec 2012 - 22:27 |
GetURL | 2 | 64.74 KB | 25 Dec 2012 - 00:50 |
W3C Link Checker | 1+1 | 0 | 09 Dec 2012 - 21:03 |
MOMspider | 1+1 | 0 | 07 Dec 2012 - 23:58 |
FavIconizer | 2 | 23.30 KB | 26 Dec 2012 - 11:23 |
Sven | 1+1 | 26.78 KB | 20 Dec 2012 - 06:19 |
QihooBot | 1 | 16 Bytes | 27 Dec 2012 - 19:52 |
lwp-request | 1 | 0 | 20 Dec 2012 - 13:29 |
|