59 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 1,718,790+427 | 306.28 GB | 31 Aug 2013 - 23:59 |
Yandex bot | 241,247+82 | 1.17 GB | 31 Aug 2013 - 23:52 |
Googlebot | 148,624+72 | 2.60 GB | 31 Aug 2013 - 23:59 |
MSNBot-media | 80,935+23375 | 1.48 GB | 31 Aug 2013 - 23:59 |
Unknown robot (identified by 'spider') | 78,185+91 | 705.05 MB | 31 Aug 2013 - 23:59 |
Unknown robot (identified by empty user agent string) | 65,844+2 | 886.88 MB | 31 Aug 2013 - 23:31 |
Unknown robot (identified by 'robot') | 42,268+22 | 587.30 MB | 31 Aug 2013 - 23:59 |
MSNBot | 19,544+235 | 460.26 MB | 31 Aug 2013 - 21:42 |
WebCollage | 18,537 | 454.93 MB | 31 Aug 2013 - 23:56 |
Unknown robot (identified by '*bot') | 17,443+370 | 237.45 MB | 31 Aug 2013 - 23:53 |
HTTrack off-line browser | 12,574+1 | 133.51 MB | 30 Aug 2013 - 04:18 |
BSpider | 11,390+1 | 213.68 MB | 31 Aug 2013 - 23:58 |
Yahoo Slurp | 10,253+14 | 121.73 MB | 31 Aug 2013 - 19:03 |
BaiDuSpider | 9,255+55 | 495.00 MB | 31 Aug 2013 - 23:55 |
Unknown robot (identified by 'crawl') | 7,064+116 | 86.21 MB | 31 Aug 2013 - 23:05 |
Custo | 5,512 | 49.71 MB | 28 Aug 2013 - 18:49 |
Sogou Spider | 4,696+178 | 56.10 MB | 31 Aug 2013 - 21:12 |
Mail.ru bot | 3,677+5 | 38.21 MB | 29 Aug 2013 - 19:45 |
ichiro | 1,586+58 | 26.79 MB | 31 Aug 2013 - 04:25 |
MJ12bot | 1,292+265 | 48.78 MB | 31 Aug 2013 - 22:27 |
psbot | 963+32 | 7.06 MB | 23 Aug 2013 - 02:36 |
Unknown robot (identified by hit on 'robots.txt') | 0+909 | 0 | 31 Aug 2013 - 23:42 |
Python-urllib | 812+20 | 13.70 MB | 31 Aug 2013 - 02:43 |
Exabot | 756+46 | 11.62 MB | 31 Aug 2013 - 21:04 |
Alexa (IA Archiver) | 419+112 | 8.43 MB | 31 Aug 2013 - 21:15 |
Feedfetcher-Google | 478 | 2.94 MB | 31 Aug 2013 - 23:01 |
Motor | 457 | 7.09 MB | 27 Aug 2013 - 18:12 |
SeznamBot | 277+42 | 15.49 MB | 31 Aug 2013 - 08:37 |
FaceBook bot | 311 | 28.87 MB | 31 Aug 2013 - 18:05 |
CFNetwork | 280 | 5.50 MB | 31 Aug 2013 - 23:32 |
Nutch | 124+55 | 3.95 MB | 30 Aug 2013 - 15:48 |
WGet tools | 141 | 19.14 MB | 28 Aug 2013 - 00:28 |
VORTEX | 107 | 1.78 MB | 22 Aug 2013 - 22:23 |
java\/[0-9] | 99+1 | 2.01 MB | 31 Aug 2013 - 17:54 |
Unknown robot (identified by 'discovery') | 97 | 0 | 30 Aug 2013 - 14:38 |
Perl tool | 73 | 343.66 KB | 30 Aug 2013 - 03:10 |
WebFilter | 36+21 | 2.10 MB | 30 Aug 2013 - 06:29 |
WordPress | 54 | 57.20 KB | 31 Aug 2013 - 22:21 |
legs | 26+27 | 741.71 KB | 27 Aug 2013 - 06:00 |
Phantom | 44 | 677.29 KB | 28 Aug 2013 - 09:19 |
XYLEME Robot | 27 | 205.28 KB | 12 Aug 2013 - 20:36 |
Web Core / Roots | 22 | 1.27 MB | 29 Aug 2013 - 16:21 |
NG 1.x (Exalead) | 21 | 1.03 MB | 30 Aug 2013 - 13:31 |
Steeler | 9+5 | 143.69 KB | 18 Aug 2013 - 17:39 |
Voila | 6+8 | 341.99 KB | 28 Aug 2013 - 05:10 |
yacy | 0+12 | 0 | 26 Aug 2013 - 14:48 |
Google AdSense | 11 | 351.86 KB | 27 Aug 2013 - 15:28 |
Jakarta commons-httpclient | 10 | 107.93 KB | 26 Aug 2013 - 17:22 |
LinkChecker | 6+3 | 85.40 KB | 23 Aug 2013 - 04:52 |
archive.org bot | 3+2 | 25.26 KB | 30 Aug 2013 - 23:12 |
WallPaper (alias crawlpaper) | 4 | 75.15 KB | 30 Aug 2013 - 17:13 |
Y!J Yahoo Japan | 2+2 | 24.19 KB | 22 Aug 2013 - 19:59 |
Netcraft | 3 | 11.65 KB | 09 Aug 2013 - 16:20 |
W3C Link Checker | 1+1 | 0 | 17 Aug 2013 - 06:13 |
Findlinks | 0+2 | 0 | 14 Aug 2013 - 10:19 |
Unknown robot (identified by 'checker') | 2 | 0 | 28 Aug 2013 - 04:41 |
Powermarks | 1 | 11.65 KB | 14 Aug 2013 - 18:59 |
larbin | 1 | 31.58 KB | 24 Aug 2013 - 18:47 |
MSIECrawler | 1 | 11.65 KB | 31 Aug 2013 - 19:19 |
|