55 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'spider') | 201,165+12 | 1.37 GB | 30 Jun 2011 - 23:20 |
Yandex bot | 88,442+102 | 417.53 MB | 30 Jun 2011 - 23:59 |
Googlebot | 70,243+79 | 827.62 MB | 30 Jun 2011 - 23:54 |
Yahoo Slurp | 53,115+132 | 632.47 MB | 30 Jun 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 41,932+512 | 568.35 MB | 30 Jun 2011 - 23:59 |
MSNBot-media | 20,073+1663 | 374.92 MB | 30 Jun 2011 - 23:57 |
Unknown robot (identified by 'robot') | 12,988+43 | 102.12 MB | 30 Jun 2011 - 23:58 |
Unknown robot (identified by 'crawl') | 6,337+105 | 69.79 MB | 30 Jun 2011 - 21:49 |
Unknown robot (identified by '*bot') | 5,078+281 | 42.90 MB | 30 Jun 2011 - 23:35 |
Motor | 4,046 | 56.05 MB | 30 Jun 2011 - 14:33 |
archive.org bot | 2,983+1 | 50.10 MB | 09 Jun 2011 - 15:40 |
Unknown robot (identified by 'discovery') | 2,821+10 | 16.40 MB | 30 Jun 2011 - 13:34 |
Speedy Spider | 2,235+312 | 28.52 MB | 30 Jun 2011 - 23:33 |
MJ12bot | 2,265+95 | 58.41 MB | 30 Jun 2011 - 22:50 |
Custo | 1,539+8 | 17.58 MB | 30 Jun 2011 - 19:32 |
BaiDuSpider | 1,417+18 | 17.39 MB | 30 Jun 2011 - 23:32 |
Unknown robot (identified by empty user agent string) | 1,290+104 | 13.34 MB | 30 Jun 2011 - 23:51 |
Nutch | 804+53 | 15.47 MB | 30 Jun 2011 - 23:19 |
psbot | 809+37 | 5.24 MB | 27 Jun 2011 - 04:23 |
bender focused_crawler | 518+90 | 13.11 MB | 30 Jun 2011 - 09:53 |
Unknown robot (identified by hit on 'robots.txt') | 0+423 | 0 | 30 Jun 2011 - 23:49 |
OutfoxBot/YodaoBot | 321 | 3.65 MB | 30 Jun 2011 - 22:38 |
Exabot | 231+30 | 1.93 MB | 30 Jun 2011 - 22:43 |
FaceBook bot | 254 | 3.47 MB | 30 Jun 2011 - 16:05 |
Feedfetcher-Google | 236 | 2.04 MB | 30 Jun 2011 - 23:21 |
Sogou Spider | 160+2 | 3.91 MB | 30 Jun 2011 - 11:18 |
VORTEX | 116 | 1.35 MB | 28 Jun 2011 - 18:29 |
Python-urllib | 113 | 2.91 MB | 23 Jun 2011 - 00:47 |
Alexa (IA Archiver) | 48+40 | 884.77 KB | 30 Jun 2011 - 23:40 |
WordPress | 80 | 440.54 KB | 27 Jun 2011 - 08:16 |
ichiro | 62+6 | 1.83 MB | 30 Jun 2011 - 12:56 |
Web Core / Roots | 62 | 1.21 MB | 29 Jun 2011 - 08:53 |
Turn It In | 57+1 | 1.33 MB | 10 Jun 2011 - 21:59 |
CFNetwork | 48 | 1.53 MB | 30 Jun 2011 - 21:27 |
BSpider | 9+26 | 115.23 KB | 30 Jun 2011 - 20:39 |
Findlinks | 17+11 | 289.65 KB | 30 Jun 2011 - 23:20 |
WebCollage | 16 | 328.26 KB | 30 Jun 2011 - 19:57 |
Ask | 9+6 | 327.42 KB | 20 Jun 2011 - 15:23 |
legs | 7+8 | 54.92 KB | 26 Jun 2011 - 20:37 |
Voila | 9+4 | 512.99 KB | 30 Jun 2011 - 00:37 |
WGet tools | 12 | 272.63 KB | 21 Jun 2011 - 17:53 |
gammaSpider, FocusedCrawler | 10 | 168.22 KB | 30 Jun 2011 - 18:49 |
larbin | 3+5 | 34.96 KB | 28 Jun 2011 - 21:47 |
Perl tool | 7 | 4.90 KB | 17 Jun 2011 - 02:23 |
Netcraft | 7 | 11.65 KB | 30 Jun 2011 - 06:47 |
Powermarks | 6 | 210.47 KB | 21 Jun 2011 - 21:39 |
java\/[0-9] | 5+1 | 45.73 KB | 27 Jun 2011 - 15:24 |
GigaBot | 3+3 | 34.96 KB | 28 Jun 2011 - 22:02 |
Mail.ru bot | 4+1 | 42.66 KB | 29 Jun 2011 - 10:06 |
EasyDL | 4 | 46.61 KB | 26 Jun 2011 - 06:44 |
Jakarta commons-httpclient | 2 | 14.77 KB | 26 Jun 2011 - 00:03 |
MOMspider | 1+1 | 0 | 09 Jun 2011 - 17:10 |
yacy | 1+1 | 8.85 KB | 28 Jun 2011 - 08:55 |
JCrawler | 1+1 | 8.85 KB | 26 Jun 2011 - 06:28 |
Heritrix | 1+1 | 25.38 KB | 06 Jun 2011 - 09:06 |
|