59 different robots | Hits | Bandwidth | Last visit |
Googlebot | 77,565+76 | 1.35 GB | 29 Feb 2012 - 23:59 |
MSNBot | 61,406+8 | 618.19 MB | 29 Feb 2012 - 18:34 |
BaiDuSpider | 39,115+87 | 419.15 MB | 29 Feb 2012 - 23:58 |
Unknown robot (identified by 'bot*') | 35,290+1930 | 446.41 MB | 29 Feb 2012 - 23:59 |
Yandex bot | 27,758+91 | 369.36 MB | 29 Feb 2012 - 23:58 |
MSNBot-media | 20,762+3065 | 451.15 MB | 29 Feb 2012 - 23:59 |
Unknown robot (identified by 'robot') | 12,377+51 | 110.61 MB | 29 Feb 2012 - 23:59 |
Unknown robot (identified by 'crawl') | 12,011+65 | 116.06 MB | 29 Feb 2012 - 23:59 |
Unknown robot (identified by '*bot') | 10,928+629 | 106.19 MB | 29 Feb 2012 - 23:29 |
Sogou Spider | 7,588+6 | 78.00 MB | 29 Feb 2012 - 23:51 |
Unknown robot (identified by 'discovery') | 3,699+185 | 42.27 MB | 29 Feb 2012 - 23:39 |
psbot | 2,937+70 | 19.14 MB | 08 Feb 2012 - 04:32 |
MJ12bot | 1,908+130 | 38.65 MB | 29 Feb 2012 - 21:04 |
Yahoo Slurp | 1,836+78 | 17.17 MB | 29 Feb 2012 - 22:27 |
WebCollage | 1,152 | 38.88 MB | 29 Feb 2012 - 23:27 |
Unknown robot (identified by hit on 'robots.txt') | 0+1149 | 0 | 29 Feb 2012 - 23:58 |
Exabot | 1,119+27 | 8.32 MB | 28 Feb 2012 - 03:37 |
Unknown robot (identified by empty user agent string) | 826+20 | 12.96 MB | 29 Feb 2012 - 21:57 |
Unknown robot (identified by 'spider') | 686+56 | 7.76 MB | 29 Feb 2012 - 21:39 |
FaceBook bot | 697 | 10.46 MB | 29 Feb 2012 - 23:02 |
Nutch | 623+51 | 12.44 MB | 24 Feb 2012 - 16:44 |
yacy | 475+10 | 5.14 MB | 29 Feb 2012 - 23:53 |
java\/[0-9] | 403+1 | 10.96 MB | 29 Feb 2012 - 23:40 |
ichiro | 339+17 | 8.20 MB | 29 Feb 2012 - 13:28 |
Feedfetcher-Google | 254 | 2.17 MB | 29 Feb 2012 - 22:26 |
OutfoxBot/YodaoBot | 208 | 2.37 MB | 29 Feb 2012 - 22:39 |
archive.org bot | 198+10 | 3.13 MB | 26 Feb 2012 - 23:10 |
Speedy Spider | 119+27 | 1.25 MB | 13 Feb 2012 - 07:17 |
BSpider | 120+24 | 1.30 MB | 29 Feb 2012 - 20:42 |
bender focused_crawler | 101+3 | 5.01 MB | 08 Feb 2012 - 18:34 |
Alexa (IA Archiver) | 49+50 | 627.98 KB | 29 Feb 2012 - 21:18 |
CFNetwork | 91 | 1.55 MB | 29 Feb 2012 - 19:13 |
SeznamBot | 62+22 | 9.62 MB | 29 Feb 2012 - 17:02 |
WordPress | 69 | 2.44 MB | 28 Feb 2012 - 19:18 |
GigaBot | 32+29 | 762.09 KB | 27 Feb 2012 - 01:19 |
Mail.ru bot | 53+1 | 761.83 KB | 29 Feb 2012 - 13:16 |
Ask | 45 | 225.75 KB | 23 Feb 2012 - 03:07 |
WGet tools | 37 | 112.25 KB | 23 Feb 2012 - 11:20 |
Perl tool | 26 | 41.17 KB | 29 Feb 2012 - 22:22 |
Python-urllib | 25 | 304.16 KB | 16 Feb 2012 - 19:49 |
larbin | 18+5 | 551.01 KB | 26 Feb 2012 - 15:20 |
Phantom | 22 | 187.27 KB | 21 Feb 2012 - 02:29 |
Custo | 22 | 681.91 KB | 23 Feb 2012 - 18:49 |
legs | 19+1 | 791.25 KB | 29 Feb 2012 - 00:35 |
Findlinks | 7+9 | 174.71 KB | 29 Feb 2012 - 11:22 |
Web Core / Roots | 12 | 47.81 KB | 24 Feb 2012 - 05:35 |
WallPaper (alias crawlpaper) | 10 | 181.46 KB | 26 Feb 2012 - 11:20 |
Powermarks | 9 | 495.58 KB | 29 Feb 2012 - 20:25 |
Voila | 6+3 | 341.99 KB | 29 Feb 2012 - 16:14 |
Google AdSense | 5 | 34.91 KB | 25 Feb 2012 - 06:48 |
Netcraft | 5 | 34.96 KB | 29 Feb 2012 - 17:42 |
Jakarta commons-httpclient | 4 | 49.61 KB | 27 Feb 2012 - 12:40 |
Turn It In | 1+2 | 8.85 KB | 27 Feb 2012 - 23:27 |
Y!J Yahoo Japan | 1+1 | 35.03 KB | 02 Feb 2012 - 21:39 |
Zeus Webster Pro | 2 | 20.50 KB | 29 Feb 2012 - 22:59 |
MOMspider | 1+1 | 0 | 07 Feb 2012 - 16:25 |
Unknown robot (identified by 'checker') | 2 | 0 | 24 Feb 2012 - 06:19 |
FavIconizer | 1 | 11.65 KB | 07 Feb 2012 - 14:25 |
Fish search | 1 | 24.87 KB | 11 Feb 2012 - 03:00 |
|