63 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 378,665+600 | 16.24 GB | 31 Jan 2013 - 23:59 |
Googlebot | 120,316+76 | 1.63 GB | 31 Jan 2013 - 23:59 |
BaiDuSpider | 110,355 | 16.71 GB | 31 Jan 2013 - 23:59 |
MSNBot-media | 60,746+21666 | 1.75 GB | 31 Jan 2013 - 23:58 |
Yandex bot | 34,811+121 | 443.24 MB | 31 Jan 2013 - 23:59 |
Unknown robot (identified by '*bot') | 29,356+415 | 291.28 MB | 31 Jan 2013 - 22:58 |
legs | 20,908+12 | 213.73 MB | 30 Jan 2013 - 20:10 |
Unknown robot (identified by 'spider') | 18,371+43 | 131.52 MB | 31 Jan 2013 - 23:58 |
Yahoo Slurp | 17,262+117 | 184.44 MB | 31 Jan 2013 - 23:46 |
WebCollage | 13,383 | 314.43 MB | 31 Jan 2013 - 23:59 |
MSNBot | 13,193+69 | 317.55 MB | 31 Jan 2013 - 23:08 |
Unknown robot (identified by 'robot') | 11,547+38 | 113.92 MB | 31 Jan 2013 - 15:24 |
Sogou Spider | 8,947+41 | 101.06 MB | 31 Jan 2013 - 23:57 |
Unknown robot (identified by 'crawl') | 8,943+36 | 95.32 MB | 31 Jan 2013 - 20:14 |
Unknown robot (identified by empty user agent string) | 4,114+41 | 101.79 MB | 31 Jan 2013 - 20:04 |
Exabot | 2,363+58 | 18.36 MB | 31 Jan 2013 - 17:47 |
psbot | 2,033+72 | 35.00 MB | 31 Jan 2013 - 23:39 |
MJ12bot | 1,594+77 | 39.52 MB | 31 Jan 2013 - 19:27 |
Custo | 932 | 9.41 MB | 27 Jan 2013 - 15:19 |
BSpider | 811+39 | 8.27 MB | 31 Jan 2013 - 23:25 |
Alexa (IA Archiver) | 554+130 | 11.28 MB | 31 Jan 2013 - 23:43 |
Unknown robot (identified by hit on 'robots.txt') | 0+632 | 0 | 31 Jan 2013 - 22:41 |
Feedfetcher-Google | 495 | 2.99 MB | 31 Jan 2013 - 22:48 |
CFNetwork | 474 | 10.19 MB | 31 Jan 2013 - 23:28 |
WGet tools | 456 | 4.85 MB | 31 Jan 2013 - 23:04 |
ichiro | 371+30 | 12.59 MB | 31 Jan 2013 - 19:35 |
Mail.ru bot | 315+18 | 4.57 MB | 31 Jan 2013 - 21:19 |
java\/[0-9] | 312 | 4.15 MB | 31 Jan 2013 - 13:18 |
SeznamBot | 249+20 | 5.92 MB | 31 Jan 2013 - 10:14 |
FaceBook bot | 254 | 4.19 MB | 31 Jan 2013 - 23:24 |
OutfoxBot/YodaoBot | 210 | 2.39 MB | 31 Jan 2013 - 21:20 |
Python-urllib | 185+6 | 2.51 MB | 31 Jan 2013 - 08:47 |
Nutch | 149+28 | 3.51 MB | 31 Jan 2013 - 13:10 |
Unknown robot (identified by 'discovery') | 86 | 0 | 31 Jan 2013 - 13:16 |
WebFilter | 46+5 | 2.56 MB | 31 Jan 2013 - 08:59 |
Web Core / Roots | 38 | 2.15 MB | 30 Jan 2013 - 17:47 |
WordPress | 33 | 45.26 KB | 30 Jan 2013 - 09:37 |
archive.org bot | 29+4 | 1.96 MB | 22 Jan 2013 - 00:13 |
StackRambler | 29 | 365.56 KB | 20 Jan 2013 - 01:47 |
Steeler | 20+8 | 2.07 MB | 19 Jan 2013 - 11:09 |
Phantom | 22 | 187.27 KB | 22 Jan 2013 - 19:34 |
Perl tool | 20 | 126.44 KB | 31 Jan 2013 - 05:59 |
Turn It In | 6+2 | 78.82 KB | 31 Jan 2013 - 02:42 |
MojeekBot | 3+3 | 338.40 KB | 31 Jan 2013 - 15:50 |
Jakarta commons-httpclient | 5 | 81.26 KB | 31 Jan 2013 - 20:02 |
WallPaper (alias crawlpaper) | 5 | 121.46 KB | 31 Jan 2013 - 23:14 |
Voila | 2+3 | 114.00 KB | 30 Jan 2013 - 23:17 |
NG 1.x (Exalead) | 4 | 29.69 KB | 13 Jan 2013 - 19:50 |
Findlinks | 0+4 | 0 | 29 Jan 2013 - 14:28 |
LinkBot | 2+1 | 14.62 KB | 19 Jan 2013 - 07:29 |
Google AdSense | 3 | 21.87 KB | 31 Jan 2013 - 04:29 |
FavIconizer | 3 | 34.96 KB | 30 Jan 2013 - 09:36 |
Netcraft | 3 | 11.65 KB | 07 Jan 2013 - 09:27 |
Boris | 1+1 | 8.42 KB | 07 Jan 2013 - 03:58 |
W3C Link Checker | 1+1 | 0 | 06 Jan 2013 - 16:44 |
MOMspider | 1+1 | 0 | 08 Jan 2013 - 00:08 |
larbin | 1+1 | 8.42 KB | 25 Jan 2013 - 16:06 |
Unknown robot (identified by 'checker') | 2 | 0 | 30 Jan 2013 - 12:11 |
yacy | 0+1 | 0 | 15 Jan 2013 - 18:47 |
HTTrack off-line browser | 0+1 | 0 | 11 Jan 2013 - 16:41 |
XYLEME Robot | 1 | 16.41 KB | 19 Jan 2013 - 05:38 |
VORTEX | 1 | 17.21 KB | 21 Jan 2013 - 09:12 |
MSIECrawler | 1 | 6.12 KB | 31 Jan 2013 - 15:04 |
|