59 different robots | Hits | Bandwidth | Last visit |
Googlebot | 104,485+74 | 1.14 GB | 30 Jun 2012 - 23:59 |
Unknown robot (identified by 'bot*') | 64,941+1011 | 764.58 MB | 30 Jun 2012 - 23:59 |
MSNBot-media | 49,727+4560 | 1.02 GB | 30 Jun 2012 - 23:58 |
Yandex bot | 45,162+78 | 551.41 MB | 30 Jun 2012 - 23:59 |
BaiDuSpider | 41,360+128 | 469.72 MB | 30 Jun 2012 - 23:59 |
MSNBot | 34,598+43 | 568.18 MB | 30 Jun 2012 - 10:29 |
Unknown robot (identified by '*bot') | 32,609+454 | 291.64 MB | 30 Jun 2012 - 23:45 |
legs | 20,421+18 | 321.68 MB | 30 Jun 2012 - 02:48 |
Unknown robot (identified by 'crawl') | 19,787+61 | 224.09 MB | 30 Jun 2012 - 19:05 |
Unknown robot (identified by 'robot') | 15,174+88 | 149.50 MB | 30 Jun 2012 - 23:55 |
Unknown robot (identified by empty user agent string) | 12,392+7 | 129.91 MB | 30 Jun 2012 - 23:58 |
Sogou Spider | 10,508+13 | 85.67 MB | 30 Jun 2012 - 23:59 |
Yahoo Slurp | 7,407+78 | 95.06 MB | 30 Jun 2012 - 23:59 |
Unknown robot (identified by 'spider') | 3,899+23 | 40.10 MB | 30 Jun 2012 - 23:48 |
MJ12bot | 3,442+128 | 68.65 MB | 30 Jun 2012 - 23:39 |
FaceBook bot | 3,493 | 62.65 MB | 30 Jun 2012 - 23:54 |
WebCollage | 2,993 | 85.53 MB | 30 Jun 2012 - 23:37 |
Unknown robot (identified by hit on 'robots.txt') | 0+1561 | 0 | 30 Jun 2012 - 23:15 |
Custo | 1,382 | 13.88 MB | 24 Jun 2012 - 20:43 |
Unknown robot (identified by 'discovery') | 1,194+21 | 7.66 MB | 30 Jun 2012 - 20:46 |
SeznamBot | 846+24 | 30.44 MB | 29 Jun 2012 - 05:15 |
Exabot | 688+22 | 5.51 MB | 30 Jun 2012 - 14:15 |
Motor | 498 | 7.20 MB | 30 Jun 2012 - 22:36 |
Feedfetcher-Google | 484 | 2.95 MB | 30 Jun 2012 - 22:02 |
archive.org bot | 393+10 | 7.78 MB | 17 Jun 2012 - 01:56 |
bender focused_crawler | 398+3 | 12.31 MB | 16 Jun 2012 - 21:05 |
Alexa (IA Archiver) | 259+116 | 5.29 MB | 30 Jun 2012 - 08:23 |
Nutch | 325+47 | 12.92 MB | 30 Jun 2012 - 06:33 |
BSpider | 325+18 | 8.28 MB | 30 Jun 2012 - 22:54 |
CFNetwork | 318 | 6.55 MB | 30 Jun 2012 - 22:12 |
OutfoxBot/YodaoBot | 224+8 | 2.44 MB | 30 Jun 2012 - 21:25 |
java\/[0-9] | 202 | 2.06 MB | 28 Jun 2012 - 14:17 |
WGet tools | 128 | 4.92 MB | 30 Jun 2012 - 21:37 |
ichiro | 74+23 | 2.61 MB | 30 Jun 2012 - 23:53 |
WordPress | 89 | 161.56 KB | 30 Jun 2012 - 16:27 |
Mail.ru bot | 54+7 | 811.51 KB | 30 Jun 2012 - 14:33 |
Python-urllib | 14+30 | 847.83 KB | 28 Jun 2012 - 20:14 |
Perl tool | 39 | 416.61 KB | 30 Jun 2012 - 16:02 |
Findlinks | 15+10 | 415.27 KB | 30 Jun 2012 - 04:15 |
Turn It In | 13+11 | 181.85 KB | 08 Jun 2012 - 09:36 |
Web Core / Roots | 24 | 480.87 KB | 29 Jun 2012 - 10:57 |
Voila | 8+4 | 455.99 KB | 29 Jun 2012 - 22:53 |
Phantom | 11 | 93.63 KB | 21 Jun 2012 - 23:00 |
Heritrix | 4+4 | 56.91 KB | 14 Jun 2012 - 13:02 |
WallPaper (alias crawlpaper) | 7 | 198.81 KB | 21 Jun 2012 - 21:36 |
VORTEX | 7 | 139.84 KB | 23 Jun 2012 - 19:22 |
Powermarks | 6 | 2.08 MB | 29 Jun 2012 - 17:16 |
Jakarta commons-httpclient | 4 | 31.58 KB | 24 Jun 2012 - 19:41 |
NG 1.x (Exalead) | 3 | 26.20 KB | 04 Jun 2012 - 15:40 |
Unknown robot (identified by 'checker') | 3 | 0 | 29 Jun 2012 - 11:30 |
Netcraft | 3 | 11.65 KB | 02 Jun 2012 - 18:09 |
Zeus Webster Pro | 2 | 20.07 KB | 22 Jun 2012 - 02:54 |
Y!J Yahoo Japan | 1+1 | 16.71 KB | 07 Jun 2012 - 07:50 |
MOMspider | 1+1 | 0 | 07 Jun 2012 - 20:36 |
yacy | 1+1 | 11.65 KB | 07 Jun 2012 - 13:49 |
Spiderman | 1+1 | 8.42 KB | 29 Jun 2012 - 15:52 |
LinkBot | 1 | 11.65 KB | 02 Jun 2012 - 03:11 |
HTTrack off-line browser | 1 | 8.97 KB | 26 Jun 2012 - 18:32 |
FavIconizer | 1 | 11.65 KB | 25 Jun 2012 - 15:43 |
|