65 different robots | Hits | Bandwidth | Last visit |
Googlebot | 38,390+84 | 545.20 MB | 31 Jan 2011 - 23:59 |
Unknown robot (identified by 'crawl') | 32,223+225 | 355.57 MB | 31 Jan 2011 - 23:59 |
Unknown robot (identified by 'discovery') | 12,568+82 | 96.35 MB | 31 Jan 2011 - 23:59 |
Yahoo Slurp | 64,220+143 | 658.00 MB | 31 Jan 2011 - 23:59 |
Yandex bot | 61,150+93 | 646.09 MB | 31 Jan 2011 - 23:59 |
WebCollage | 1,102 | 32.87 MB | 31 Jan 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 28,354+2161 | 310.39 MB | 31 Jan 2011 - 23:58 |
Unknown robot (identified by 'spider') | 94,883+12 | 631.13 MB | 31 Jan 2011 - 23:58 |
ichiro | 554+13 | 11.38 MB | 31 Jan 2011 - 23:46 |
BaiDuSpider | 3,714+52 | 48.85 MB | 31 Jan 2011 - 23:36 |
MSNBot-media | 39,211+2462 | 761.59 MB | 31 Jan 2011 - 23:32 |
Feedfetcher-Google | 242 | 2.09 MB | 31 Jan 2011 - 23:25 |
Exabot | 262+34 | 2.12 MB | 31 Jan 2011 - 23:01 |
Unknown robot (identified by empty user agent string) | 921+99 | 12.82 MB | 31 Jan 2011 - 22:23 |
Unknown robot (identified by 'robot') | 3,155+22 | 19.91 MB | 31 Jan 2011 - 22:19 |
Speedy Spider | 933+298 | 8.50 MB | 31 Jan 2011 - 22:15 |
Unknown robot (identified by hit on 'robots.txt') | 0+355 | 0 | 31 Jan 2011 - 22:08 |
Unknown robot (identified by '*bot') | 14+7 | 398.30 KB | 31 Jan 2011 - 21:55 |
BSpider | 21+5 | 9.00 MB | 31 Jan 2011 - 21:36 |
The web archive (IA Archiver) | 0+4 | 0 | 31 Jan 2011 - 21:18 |
Sogou Spider | 136+9 | 1.38 MB | 31 Jan 2011 - 17:53 |
CFNetwork | 219 | 2.47 MB | 31 Jan 2011 - 11:10 |
Alexa (IA Archiver) | 25+17 | 402.16 KB | 31 Jan 2011 - 08:15 |
Nutch | 29+21 | 731.41 KB | 31 Jan 2011 - 04:59 |
MJ12bot | 339+45 | 5.78 MB | 31 Jan 2011 - 04:35 |
Findlinks | 96+2 | 682.39 KB | 30 Jan 2011 - 20:56 |
java\/[0-9] | 11 | 75.48 KB | 30 Jan 2011 - 20:53 |
Powermarks | 6 | 81.48 KB | 30 Jan 2011 - 08:20 |
Voila | 8+4 | 455.99 KB | 30 Jan 2011 - 04:41 |
Motor | 718 | 7.60 MB | 29 Jan 2011 - 12:17 |
bender focused_crawler | 15+12 | 416.16 KB | 28 Jan 2011 - 17:58 |
MSNBot | 5,605+24 | 82.47 MB | 28 Jan 2011 - 14:12 |
WGet tools | 134 | 10.91 KB | 28 Jan 2011 - 06:20 |
Python-urllib | 99 | 3.75 MB | 28 Jan 2011 - 01:18 |
FaceBook bot | 76 | 1.39 MB | 27 Jan 2011 - 14:10 |
Ask | 16+12 | 631.27 KB | 27 Jan 2011 - 12:47 |
Scooter | 0+5 | 0 | 25 Jan 2011 - 21:11 |
Netcraft | 3 | 11.63 KB | 25 Jan 2011 - 17:37 |
Jakarta commons-httpclient | 2 | 45.13 KB | 25 Jan 2011 - 04:59 |
Custo | 727+7 | 9.47 MB | 24 Jan 2011 - 17:49 |
MOMspider | 2+2 | 0 | 24 Jan 2011 - 15:56 |
NG 1.x (Exalead) | 26 | 309.36 KB | 24 Jan 2011 - 08:18 |
legs | 19+10 | 460.36 KB | 23 Jan 2011 - 16:02 |
WordPress | 44 | 96.31 KB | 23 Jan 2011 - 13:41 |
Allrati | 4 | 35.32 KB | 22 Jan 2011 - 10:30 |
Heritrix | 0+1 | 0 | 22 Jan 2011 - 04:46 |
EasyDL | 3 | 34.89 KB | 21 Jan 2011 - 01:35 |
Web Core / Roots | 5 | 60.55 KB | 20 Jan 2011 - 04:41 |
StackRambler | 0+1 | 0 | 19 Jan 2011 - 21:06 |
Y!J Yahoo Japan | 1+1 | 34.67 KB | 18 Jan 2011 - 07:19 |
HTTrack off-line browser | 1 | 12.78 KB | 17 Jan 2011 - 23:38 |
WallPaper (alias crawlpaper) | 12 | 184.71 KB | 17 Jan 2011 - 16:46 |
Bobby | 204 | 2.19 MB | 17 Jan 2011 - 13:29 |
GigaBot | 5+6 | 128.70 KB | 16 Jan 2011 - 03:03 |
larbin | 1+1 | 11.63 KB | 16 Jan 2011 - 03:01 |
MSIECrawler | 3 | 61.71 KB | 13 Jan 2011 - 22:38 |
Perl tool | 13 | 43.66 KB | 11 Jan 2011 - 01:16 |
Webdup | 2 | 18.52 KB | 10 Jan 2011 - 13:07 |
VORTEX | 47 | 778.61 KB | 09 Jan 2011 - 09:03 |
Digger | 1 | 11.63 KB | 08 Jan 2011 - 15:05 |
Mail.ru bot | 0+1 | 0 | 08 Jan 2011 - 10:16 |
MojeekBot | 1+1 | 8.83 KB | 08 Jan 2011 - 03:39 |
FavIconizer | 1 | 11.63 KB | 05 Jan 2011 - 00:15 |
archive.org bot | 2,979+2 | 39.70 MB | 02 Jan 2011 - 19:04 |
Vagabondo | 1+1 | 25 Bytes | 02 Jan 2011 - 07:48 |
|