59 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 10,101+179 | 108.71 MB | 31 Aug 2011 - 23:59 |
Yandex bot | 43,241+68 | 556.49 MB | 31 Aug 2011 - 23:59 |
Yahoo Slurp | 58,427+162 | 644.11 MB | 31 Aug 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 21,956+584 | 267.71 MB | 31 Aug 2011 - 23:59 |
Unknown robot (identified by '*bot') | 8,140+363 | 81.15 MB | 31 Aug 2011 - 23:58 |
Sogou Spider | 1,643+2 | 12.89 MB | 31 Aug 2011 - 23:58 |
BaiDuSpider | 3,752+33 | 40.29 MB | 31 Aug 2011 - 23:58 |
Googlebot | 66,472+78 | 904.72 MB | 31 Aug 2011 - 23:56 |
MSNBot-media | 6,937+1348 | 128.54 MB | 31 Aug 2011 - 23:45 |
Unknown robot (identified by hit on 'robots.txt') | 0+1095 | 0 | 31 Aug 2011 - 23:27 |
Exabot | 347+31 | 3.16 MB | 31 Aug 2011 - 23:08 |
FaceBook bot | 1,224 | 16.99 MB | 31 Aug 2011 - 23:06 |
legs | 977+77 | 16.36 MB | 31 Aug 2011 - 23:03 |
MSNBot | 4,447+59 | 116.10 MB | 31 Aug 2011 - 22:53 |
WebCollage | 265 | 5.07 MB | 31 Aug 2011 - 22:30 |
OutfoxBot/YodaoBot | 228 | 2.59 MB | 31 Aug 2011 - 22:25 |
Feedfetcher-Google | 286 | 2.25 MB | 31 Aug 2011 - 21:55 |
Unknown robot (identified by 'discovery') | 574+244 | 4.14 MB | 31 Aug 2011 - 20:41 |
VORTEX | 1,991 | 29.61 MB | 31 Aug 2011 - 20:40 |
Unknown robot (identified by 'spider') | 22,198+15 | 300.36 MB | 31 Aug 2011 - 19:30 |
bender focused_crawler | 144+10 | 2.75 MB | 31 Aug 2011 - 19:28 |
Findlinks | 15+12 | 392.95 KB | 31 Aug 2011 - 18:45 |
Unknown robot (identified by empty user agent string) | 2,736+256 | 41.19 MB | 31 Aug 2011 - 18:43 |
WordPress | 92 | 327.72 KB | 31 Aug 2011 - 16:29 |
java\/[0-9] | 2,510+1 | 939.32 KB | 31 Aug 2011 - 16:05 |
Python-urllib | 12 | 126.30 KB | 31 Aug 2011 - 15:37 |
MJ12bot | 1,212+106 | 32.35 MB | 31 Aug 2011 - 12:18 |
Nutch | 571+67 | 10.29 MB | 31 Aug 2011 - 09:33 |
Alexa (IA Archiver) | 33+35 | 532.67 KB | 31 Aug 2011 - 09:19 |
Speedy Spider | 1,476+226 | 15.62 MB | 31 Aug 2011 - 07:50 |
BSpider | 20+16 | 150.94 KB | 31 Aug 2011 - 06:22 |
Unknown robot (identified by 'robot') | 16,226+52 | 153.25 MB | 31 Aug 2011 - 06:11 |
CFNetwork | 47 | 1.12 MB | 30 Aug 2011 - 21:04 |
Unknown robot (identified by 'checker') | 2 | 0 | 30 Aug 2011 - 07:38 |
Custo | 1,176+11 | 10.68 MB | 29 Aug 2011 - 23:25 |
MojeekBot | 1+1 | 11.65 KB | 29 Aug 2011 - 12:04 |
Voila | 8+4 | 455.99 KB | 28 Aug 2011 - 15:52 |
Motor | 891 | 12.65 MB | 28 Aug 2011 - 15:14 |
Powermarks | 5 | 148.67 KB | 28 Aug 2011 - 05:51 |
ichiro | 190+5 | 6.08 MB | 27 Aug 2011 - 23:54 |
WGet tools | 25 | 57.37 KB | 27 Aug 2011 - 04:55 |
lwp-trivial | 3 | 48 Bytes | 27 Aug 2011 - 00:15 |
Perl tool | 10 | 108.56 KB | 26 Aug 2011 - 23:20 |
XYLEME Robot | 3 | 6.67 KB | 26 Aug 2011 - 15:48 |
Jakarta commons-httpclient | 14 | 233.55 KB | 26 Aug 2011 - 08:19 |
Heritrix | 2+2 | 40.38 KB | 25 Aug 2011 - 07:22 |
Netcraft | 3 | 11.65 KB | 24 Aug 2011 - 20:13 |
FavIconizer | 2 | 23.30 KB | 24 Aug 2011 - 06:42 |
GigaBot | 4+4 | 57.14 KB | 22 Aug 2011 - 22:45 |
archive.org bot | 26+1 | 390.07 KB | 22 Aug 2011 - 07:59 |
MSIECrawler | 34+7 | 344.39 KB | 22 Aug 2011 - 03:08 |
WallPaper (alias crawlpaper) | 4 | 68.02 KB | 21 Aug 2011 - 16:03 |
psbot | 1,116+39 | 7.06 MB | 18 Aug 2011 - 21:51 |
Y!J Yahoo Japan | 0+1 | 0 | 17 Aug 2011 - 17:10 |
larbin | 3+2 | 32.16 KB | 16 Aug 2011 - 14:38 |
yacy | 1+1 | 64.85 KB | 08 Aug 2011 - 21:20 |
MOMspider | 1+1 | 0 | 07 Aug 2011 - 19:40 |
Mail.ru bot | 1 | 5.86 KB | 05 Aug 2011 - 16:31 |
HTTrack off-line browser | 2+1 | 17.71 KB | 04 Aug 2011 - 06:57 |
|