62 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'robot') | 32,918+45 | 345.44 MB | 30 Nov 2012 - 23:59 |
Googlebot | 95,226+72 | 1.21 GB | 30 Nov 2012 - 23:59 |
Unknown robot (identified by 'bot*') | 124,401+508 | 1.46 GB | 30 Nov 2012 - 23:59 |
Yandex bot | 31,785+74 | 449.12 MB | 30 Nov 2012 - 23:59 |
BaiDuSpider | 83,230+41 | 921.02 MB | 30 Nov 2012 - 23:59 |
WebCollage | 8,783 | 218.56 MB | 30 Nov 2012 - 23:58 |
MSNBot-media | 46,128+9102 | 880.84 MB | 30 Nov 2012 - 23:57 |
Feedfetcher-Google | 483 | 2.92 MB | 30 Nov 2012 - 23:38 |
Alexa (IA Archiver) | 446+120 | 33.89 MB | 30 Nov 2012 - 23:37 |
Unknown robot (identified by 'spider') | 21,194+80 | 176.13 MB | 30 Nov 2012 - 23:35 |
Unknown robot (identified by empty user agent string) | 1,439+62 | 11.32 MB | 30 Nov 2012 - 23:31 |
Yahoo Slurp | 18,563+106 | 198.85 MB | 30 Nov 2012 - 23:26 |
BSpider | 628+26 | 5.85 MB | 30 Nov 2012 - 23:23 |
OutfoxBot/YodaoBot | 175 | 1.99 MB | 30 Nov 2012 - 23:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+602 | 0 | 30 Nov 2012 - 23:18 |
Unknown robot (identified by '*bot') | 35,246+470 | 329.09 MB | 30 Nov 2012 - 23:05 |
FaceBook bot | 1,462+1 | 25.80 MB | 30 Nov 2012 - 22:43 |
Y!J Yahoo Japan | 64+62 | 451.74 KB | 30 Nov 2012 - 22:12 |
MSNBot | 31,871+57 | 596.08 MB | 30 Nov 2012 - 21:25 |
Sogou Spider | 6,149+51 | 52.13 MB | 30 Nov 2012 - 21:12 |
Unknown robot (identified by 'crawl') | 25,975+87 | 258.50 MB | 30 Nov 2012 - 20:23 |
CFNetwork | 529 | 11.31 MB | 30 Nov 2012 - 20:05 |
Exabot | 623+29 | 6.28 MB | 30 Nov 2012 - 18:43 |
Nutch | 313+68 | 23.65 MB | 30 Nov 2012 - 18:40 |
XYLEME Robot | 1 | 18.31 KB | 30 Nov 2012 - 16:49 |
ichiro | 8,999+20 | 153.65 MB | 30 Nov 2012 - 16:04 |
Unknown robot (identified by 'discovery') | 3,774+18 | 34.10 MB | 30 Nov 2012 - 15:13 |
MJ12bot | 3,220+92 | 50.54 MB | 30 Nov 2012 - 14:47 |
WGet tools | 454 | 7.13 MB | 30 Nov 2012 - 13:52 |
Mail.ru bot | 451+14 | 7.88 MB | 30 Nov 2012 - 11:19 |
WordPress | 72 | 205.05 KB | 30 Nov 2012 - 08:32 |
java\/[0-9] | 279 | 22.36 MB | 30 Nov 2012 - 07:07 |
SeznamBot | 225+28 | 6.82 MB | 30 Nov 2012 - 00:26 |
Jakarta commons-httpclient | 6 | 72.27 KB | 28 Nov 2012 - 20:21 |
Web Core / Roots | 237 | 7.42 MB | 28 Nov 2012 - 06:56 |
Findlinks | 0+4 | 0 | 28 Nov 2012 - 00:54 |
psbot | 1,082+183 | 12.84 MB | 28 Nov 2012 - 00:12 |
Python-urllib | 17+6 | 494.44 KB | 27 Nov 2012 - 08:29 |
FavIconizer | 2 | 23.30 KB | 26 Nov 2012 - 07:28 |
WallPaper (alias crawlpaper) | 8 | 151.78 KB | 25 Nov 2012 - 16:45 |
Motor | 1 | 11.65 KB | 25 Nov 2012 - 11:48 |
larbin | 1+1 | 10.74 KB | 25 Nov 2012 - 00:57 |
Phantom | 12 | 93.65 KB | 24 Nov 2012 - 22:22 |
archive.org bot | 10+4 | 82.57 KB | 24 Nov 2012 - 14:56 |
WebFilter | 7+2 | 84.50 KB | 23 Nov 2012 - 12:16 |
Turn It In | 7+9 | 128.71 KB | 23 Nov 2012 - 04:28 |
StackRambler | 17 | 166.94 KB | 22 Nov 2012 - 07:29 |
Heritrix | 2+2 | 30.17 KB | 22 Nov 2012 - 00:51 |
Voila | 3+3 | 171.00 KB | 21 Nov 2012 - 22:13 |
Perl tool | 15 | 62.46 KB | 20 Nov 2012 - 22:29 |
Unknown robot (identified by 'checker') | 2 | 0 | 20 Nov 2012 - 02:55 |
Custo | 1,240 | 11.49 MB | 18 Nov 2012 - 16:20 |
GigaBot | 1 | 11.65 KB | 16 Nov 2012 - 10:43 |
HTMLParser | 78 | 1.75 MB | 13 Nov 2012 - 15:45 |
yacy | 0+1 | 0 | 13 Nov 2012 - 03:03 |
MOMspider | 1+1 | 0 | 07 Nov 2012 - 22:55 |
Susie | 1 | 57.00 KB | 07 Nov 2012 - 11:33 |
Netcraft | 3 | 11.65 KB | 06 Nov 2012 - 14:17 |
HTTrack off-line browser | 4 | 50.60 KB | 06 Nov 2012 - 12:46 |
MSIECrawler | 0+1 | 0 | 04 Nov 2012 - 10:48 |
JCrawler | 0+1 | 0 | 02 Nov 2012 - 22:38 |
Unknown robot (identified by 'sucker') | 1 | 8.42 KB | 01 Nov 2012 - 07:15 |
|