61 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 1,276,158+617 | 246.35 GB | 31 Jul 2013 - 23:59 |
Yandex bot | 187,241+189 | 1.77 GB | 31 Jul 2013 - 23:59 |
Googlebot | 152,633+66 | 1.93 GB | 31 Jul 2013 - 23:59 |
MSNBot-media | 61,458+19297 | 1.14 GB | 31 Jul 2013 - 23:59 |
Unknown robot (identified by 'spider') | 53,906+41 | 477.79 MB | 31 Jul 2013 - 23:56 |
HTTrack off-line browser | 44,830+1 | 651.90 MB | 26 Jul 2013 - 05:54 |
Unknown robot (identified by '*bot') | 26,294+444 | 305.86 MB | 31 Jul 2013 - 23:30 |
WebCollage | 22,145 | 490.88 MB | 31 Jul 2013 - 23:59 |
BaiDuSpider | 18,959+41 | 851.34 MB | 31 Jul 2013 - 23:58 |
Unknown robot (identified by 'crawl') | 12,406+374 | 138.72 MB | 31 Jul 2013 - 23:53 |
Yahoo Slurp | 11,604+8 | 143.98 MB | 30 Jul 2013 - 10:08 |
Unknown robot (identified by 'robot') | 10,878+23 | 131.77 MB | 31 Jul 2013 - 21:14 |
Custo | 10,091 | 91.61 MB | 30 Jul 2013 - 19:01 |
MSNBot | 8,995+431 | 577.16 MB | 31 Jul 2013 - 17:10 |
BSpider | 7,260+4 | 96.79 MB | 31 Jul 2013 - 20:26 |
Unknown robot (identified by empty user agent string) | 3,845 | 57.12 MB | 31 Jul 2013 - 22:30 |
Sogou Spider | 3,233+44 | 42.62 MB | 31 Jul 2013 - 21:34 |
MJ12bot | 2,905+351 | 67.55 MB | 31 Jul 2013 - 21:39 |
Mail.ru bot | 2,876+8 | 26.21 MB | 31 Jul 2013 - 19:57 |
WebFilter | 1,844+15 | 20.87 MB | 30 Jul 2013 - 15:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+1476 | 0 | 31 Jul 2013 - 22:45 |
Python-urllib | 1,359+16 | 20.25 MB | 31 Jul 2013 - 22:52 |
ichiro | 1,144+63 | 30.85 MB | 31 Jul 2013 - 22:01 |
Exabot | 864+57 | 9.19 MB | 31 Jul 2013 - 21:50 |
psbot | 709+57 | 5.83 MB | 31 Jul 2013 - 23:58 |
FaceBook bot | 547 | 20.55 MB | 31 Jul 2013 - 23:01 |
Alexa (IA Archiver) | 422+108 | 11.68 MB | 31 Jul 2013 - 22:56 |
Feedfetcher-Google | 498 | 3.07 MB | 31 Jul 2013 - 23:42 |
SeznamBot | 337+27 | 17.52 MB | 31 Jul 2013 - 16:56 |
CFNetwork | 275 | 4.88 MB | 31 Jul 2013 - 20:22 |
Nutch | 126+65 | 3.59 MB | 31 Jul 2013 - 22:54 |
Motor | 165 | 2.70 MB | 31 Jul 2013 - 15:10 |
Unknown robot (identified by 'discovery') | 109 | 0 | 30 Jul 2013 - 17:04 |
WordPress | 82 | 68.23 KB | 29 Jul 2013 - 18:51 |
OutfoxBot/YodaoBot | 54 | 629.23 KB | 08 Jul 2013 - 01:14 |
Perl tool | 54 | 305.03 KB | 30 Jul 2013 - 02:49 |
java\/[0-9] | 39+1 | 598.82 KB | 30 Jul 2013 - 12:27 |
legs | 19+13 | 306.23 KB | 31 Jul 2013 - 22:19 |
Phantom | 26 | 542.10 KB | 23 Jul 2013 - 07:01 |
Web Core / Roots | 26 | 998.46 KB | 18 Jul 2013 - 12:13 |
WGet tools | 24 | 249.94 KB | 31 Jul 2013 - 09:36 |
NG 1.x (Exalead) | 13 | 186.01 KB | 30 Jul 2013 - 10:08 |
Jakarta commons-httpclient | 12 | 181.28 KB | 29 Jul 2013 - 17:36 |
W3C Link Checker | 6+6 | 0 | 17 Jul 2013 - 10:55 |
Sven | 11+1 | 93.63 KB | 16 Jul 2013 - 11:44 |
yacy | 0+11 | 0 | 31 Jul 2013 - 11:02 |
WallPaper (alias crawlpaper) | 9 | 168.97 KB | 25 Jul 2013 - 21:36 |
Voila | 4+3 | 228.00 KB | 21 Jul 2013 - 08:50 |
Google AdSense | 7 | 66.48 KB | 31 Jul 2013 - 18:15 |
LinkChecker | 2+2 | 8.42 KB | 21 Jul 2013 - 02:07 |
Turn It In | 2+2 | 14.52 KB | 06 Jul 2013 - 12:18 |
archive.org bot | 2+2 | 21.17 KB | 24 Jul 2013 - 20:03 |
FavIconizer | 3 | 34.96 KB | 30 Jul 2013 - 19:21 |
Netcraft | 3 | 11.65 KB | 08 Jul 2013 - 08:52 |
MojeekBot | 1+1 | 5.78 KB | 02 Jul 2013 - 01:06 |
MOMspider | 1+1 | 0 | 08 Jul 2013 - 08:20 |
Findlinks | 1+1 | 11.65 KB | 25 Jul 2013 - 14:06 |
larbin | 1+1 | 8.42 KB | 05 Jul 2013 - 23:08 |
Powermarks | 1 | 11.65 KB | 10 Jul 2013 - 11:43 |
StackRambler | 1 | 17.85 KB | 04 Jul 2013 - 08:55 |
Speedy Spider | 1 | 8.42 KB | 26 Jul 2013 - 13:49 |
|