64 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 2,136,951+2273 | 392.11 GB | 31 May 2013 - 23:59 |
Googlebot | 208,597+76 | 2.56 GB | 31 May 2013 - 23:59 |
Unknown robot (identified by '*bot') | 25,582+413 | 268.36 MB | 31 May 2013 - 23:58 |
Sogou Spider | 6,357+40 | 66.15 MB | 31 May 2013 - 23:58 |
MSNBot-media | 16,677+14611 | 326.06 MB | 31 May 2013 - 23:58 |
WebCollage | 21,896 | 465.67 MB | 31 May 2013 - 23:56 |
BaiDuSpider | 110,892 | 17.16 GB | 31 May 2013 - 23:54 |
Yandex bot | 31,869+87 | 187.37 MB | 31 May 2013 - 23:54 |
Feedfetcher-Google | 488 | 3.17 MB | 31 May 2013 - 23:51 |
Unknown robot (identified by 'robot') | 12,294+40 | 125.37 MB | 31 May 2013 - 23:47 |
Unknown robot (identified by 'spider') | 50,377+61 | 419.95 MB | 31 May 2013 - 23:34 |
WebFilter | 134+15 | 1.05 MB | 31 May 2013 - 23:06 |
Yahoo Slurp | 10,444+68 | 125.08 MB | 31 May 2013 - 22:47 |
Python-urllib | 211+28 | 2.68 MB | 31 May 2013 - 22:28 |
psbot | 4,517+120 | 38.54 MB | 31 May 2013 - 22:21 |
Unknown robot (identified by hit on 'robots.txt') | 0+752 | 0 | 31 May 2013 - 22:14 |
Perl tool | 55 | 2.71 MB | 31 May 2013 - 22:03 |
Unknown robot (identified by empty user agent string) | 2,892+1 | 63.51 MB | 31 May 2013 - 21:56 |
MJ12bot | 2,224+120 | 42.66 MB | 31 May 2013 - 21:32 |
Unknown robot (identified by 'discovery') | 4,407+17 | 47.36 MB | 31 May 2013 - 20:59 |
Custo | 14,472 | 116.57 MB | 31 May 2013 - 20:47 |
BSpider | 1,578+11 | 20.38 MB | 31 May 2013 - 19:18 |
Mail.ru bot | 2,071+3 | 18.79 MB | 31 May 2013 - 18:36 |
Exabot | 1,934+68 | 13.25 MB | 31 May 2013 - 18:12 |
Alexa (IA Archiver) | 172+43 | 2.58 MB | 31 May 2013 - 15:23 |
CFNetwork | 358 | 8.03 MB | 31 May 2013 - 14:49 |
MSNBot | 6,569+44 | 193.88 MB | 31 May 2013 - 12:21 |
FaceBook bot | 137+4 | 3.57 MB | 31 May 2013 - 11:33 |
Unknown robot (identified by 'crawl') | 63+27 | 1.17 MB | 31 May 2013 - 09:55 |
OutfoxBot/YodaoBot | 39 | 454.44 KB | 31 May 2013 - 02:58 |
Phantom | 40 | 360.94 KB | 30 May 2013 - 13:43 |
SeznamBot | 285+12 | 6.35 MB | 30 May 2013 - 11:30 |
java\/[0-9] | 53+1 | 1.24 MB | 30 May 2013 - 11:00 |
Nutch | 44+16 | 1.12 MB | 29 May 2013 - 18:59 |
Voila | 3+3 | 171.00 KB | 29 May 2013 - 08:21 |
LinkChecker | 2+1 | 11.65 KB | 29 May 2013 - 05:48 |
WallPaper (alias crawlpaper) | 5 | 61.78 KB | 29 May 2013 - 04:41 |
FavIconizer | 3 | 34.96 KB | 29 May 2013 - 01:47 |
Google AdSense | 2 | 13.83 KB | 28 May 2013 - 20:36 |
Heritrix | 2,415+6 | 42.45 MB | 28 May 2013 - 16:00 |
Turn It In | 15+12 | 1.91 MB | 28 May 2013 - 06:30 |
ichiro | 317+27 | 6.12 MB | 28 May 2013 - 01:52 |
Jakarta commons-httpclient | 6 | 54.91 KB | 27 May 2013 - 17:35 |
Powermarks | 1 | 11.65 KB | 27 May 2013 - 07:56 |
Web Core / Roots | 28 | 3.95 MB | 26 May 2013 - 02:15 |
WordPress | 267 | 543.60 KB | 25 May 2013 - 22:23 |
Y!J Yahoo Japan | 2+2 | 23.24 KB | 25 May 2013 - 07:10 |
legs | 9+34 | 101.68 KB | 24 May 2013 - 04:55 |
Unknown robot (identified by 'checker') | 4 | 25 Bytes | 23 May 2013 - 01:51 |
Fish search | 1 | 31.32 KB | 21 May 2013 - 20:44 |
archive.org bot | 1+3 | 65.33 KB | 21 May 2013 - 18:06 |
Motor | 43 | 468.67 KB | 19 May 2013 - 15:02 |
W3C Validator | 1 | 25 Bytes | 16 May 2013 - 11:26 |
FeedValidator | 1 | 25 Bytes | 16 May 2013 - 11:26 |
Unknown robot (identified by 'hunter') | 4 | 67.58 KB | 13 May 2013 - 17:05 |
NG 1.x (Exalead) | 22 | 440.89 KB | 12 May 2013 - 22:48 |
WGet tools | 29 | 135.52 KB | 12 May 2013 - 19:55 |
MojeekBot | 2+1 | 35.03 KB | 09 May 2013 - 03:19 |
Netcraft | 3 | 11.65 KB | 08 May 2013 - 15:17 |
MOMspider | 1+1 | 0 | 08 May 2013 - 04:13 |
yacy | 1 | 11.65 KB | 05 May 2013 - 14:01 |
W3C Link Checker | 1+1 | 0 | 05 May 2013 - 08:45 |
QihooBot | 2 | 20.42 KB | 04 May 2013 - 13:24 |
XYLEME Robot | 1 | 15.19 KB | 04 May 2013 - 05:25 |
|