40 different robots | Hits | Bandwidth | Last visit |
Googlebot | 12,076+6 | 161.33 MB | 04 Oct 2012 - 00:00 |
BaiDuSpider | 11,168+13 | 115.91 MB | 04 Oct 2012 - 00:00 |
MSNBot-media | 2,586+811 | 42.18 MB | 03 Oct 2012 - 23:59 |
Yandex bot | 1,710+8 | 28.75 MB | 03 Oct 2012 - 23:59 |
Unknown robot (identified by '*bot') | 4,296+40 | 41.64 MB | 03 Oct 2012 - 23:59 |
Unknown robot (identified by empty user agent string) | 310+16 | 3.88 MB | 03 Oct 2012 - 23:59 |
Unknown robot (identified by 'bot*') | 18,579+191 | 194.55 MB | 03 Oct 2012 - 23:58 |
WebCollage | 855 | 21.13 MB | 03 Oct 2012 - 23:56 |
Nutch | 32+2 | 591.29 KB | 03 Oct 2012 - 23:47 |
java\/[0-9] | 30+8 | 527.09 KB | 03 Oct 2012 - 23:47 |
FaceBook bot | 379 | 7.90 MB | 03 Oct 2012 - 23:45 |
Sogou Spider | 1,530+3 | 12.29 MB | 03 Oct 2012 - 23:23 |
archive.org bot | 394+3 | 6.23 MB | 03 Oct 2012 - 23:11 |
Unknown robot (identified by hit on 'robots.txt') | 0+59 | 0 | 03 Oct 2012 - 23:01 |
BSpider | 65+3 | 785.87 KB | 03 Oct 2012 - 22:59 |
Feedfetcher-Google | 48 | 297.26 KB | 03 Oct 2012 - 22:57 |
Unknown robot (identified by 'spider') | 1,434+1 | 23.10 MB | 03 Oct 2012 - 22:53 |
Exabot | 15+2 | 3.37 MB | 03 Oct 2012 - 22:51 |
Yahoo Slurp | 1,273+12 | 12.25 MB | 03 Oct 2012 - 22:47 |
Web Core / Roots | 18 | 436.06 KB | 03 Oct 2012 - 22:47 |
CFNetwork | 44 | 739.63 KB | 03 Oct 2012 - 22:35 |
WGet tools | 5 | 83.76 KB | 03 Oct 2012 - 21:10 |
psbot | 307+11 | 6.00 MB | 03 Oct 2012 - 20:17 |
legs | 2+1 | 15.64 KB | 03 Oct 2012 - 20:10 |
Unknown robot (identified by 'crawl') | 1,325+20 | 12.60 MB | 03 Oct 2012 - 20:04 |
Unknown robot (identified by 'robot') | 8,419+5 | 92.16 MB | 03 Oct 2012 - 19:46 |
SeznamBot | 46+2 | 1.30 MB | 03 Oct 2012 - 19:11 |
Alexa (IA Archiver) | 15+8 | 119.09 KB | 03 Oct 2012 - 16:39 |
MJ12bot | 130+10 | 1.51 MB | 03 Oct 2012 - 16:19 |
Python-urllib | 0+2 | 0 | 03 Oct 2012 - 12:48 |
MSNBot | 2,012+3 | 48.34 MB | 03 Oct 2012 - 10:37 |
Perl tool | 1 | 11.65 KB | 03 Oct 2012 - 04:58 |
WebFilter | 2 | 19.87 KB | 02 Oct 2012 - 21:33 |
ichiro | 1+1 | 34.31 KB | 02 Oct 2012 - 16:28 |
Findlinks | 0+1 | 0 | 02 Oct 2012 - 16:15 |
Unknown robot (identified by 'discovery') | 388+2 | 3.32 MB | 02 Oct 2012 - 03:41 |
WallPaper (alias crawlpaper) | 2 | 21.76 KB | 02 Oct 2012 - 03:02 |
Jakarta commons-httpclient | 1 | 11.65 KB | 01 Oct 2012 - 16:52 |
Mail.ru bot | 22 | 299.60 KB | 01 Oct 2012 - 13:50 |
OutfoxBot/YodaoBot | 1 | 11.65 KB | 01 Oct 2012 - 03:40 |
|