62 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 52,143+1781 | 811.01 MB | 31 Dec 2011 - 23:59 |
Googlebot | 72,821+93 | 962.76 MB | 31 Dec 2011 - 23:59 |
Unknown robot (identified by 'spider') | 556+20 | 4.51 MB | 31 Dec 2011 - 23:59 |
MSNBot-media | 12,813+2332 | 246.96 MB | 31 Dec 2011 - 23:57 |
BaiDuSpider | 42,853+84 | 436.77 MB | 31 Dec 2011 - 23:57 |
Yandex bot | 9,488+85 | 141.91 MB | 31 Dec 2011 - 23:56 |
FaceBook bot | 582 | 9.42 MB | 31 Dec 2011 - 23:46 |
Sogou Spider | 3,180+14 | 47.03 MB | 31 Dec 2011 - 23:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+456 | 0 | 31 Dec 2011 - 23:40 |
Unknown robot (identified by 'crawl') | 12,351+33 | 149.89 MB | 31 Dec 2011 - 23:32 |
Unknown robot (identified by '*bot') | 4,414+412 | 46.29 MB | 31 Dec 2011 - 23:23 |
WebCollage | 504 | 16.45 MB | 31 Dec 2011 - 23:06 |
Yahoo Slurp | 2,876+83 | 33.55 MB | 31 Dec 2011 - 22:53 |
BSpider | 71+27 | 6.06 MB | 31 Dec 2011 - 22:35 |
WordPress | 116 | 237.68 KB | 31 Dec 2011 - 22:19 |
Perl tool | 51 | 599.47 KB | 31 Dec 2011 - 21:53 |
Nutch | 448+51 | 9.13 MB | 31 Dec 2011 - 21:22 |
Exabot | 744+34 | 5.84 MB | 31 Dec 2011 - 18:16 |
Python-urllib | 140+2 | 1.88 MB | 31 Dec 2011 - 18:14 |
MJ12bot | 1,656+124 | 36.39 MB | 31 Dec 2011 - 16:48 |
Unknown robot (identified by 'robot') | 22,326+49 | 212.21 MB | 31 Dec 2011 - 16:44 |
CFNetwork | 17 | 447.32 KB | 31 Dec 2011 - 11:09 |
MSIECrawler | 2+1 | 25.91 KB | 31 Dec 2011 - 11:08 |
MSNBot | 29,088+5 | 294.38 MB | 31 Dec 2011 - 10:51 |
Feedfetcher-Google | 270 | 2.28 MB | 31 Dec 2011 - 09:17 |
yacy | 32+12 | 701.80 KB | 31 Dec 2011 - 05:08 |
WGet tools | 94+2 | 78.08 KB | 31 Dec 2011 - 05:06 |
FeedCrawl by feed@aobo.com | 6 | 0 | 31 Dec 2011 - 05:06 |
OutfoxBot/YodaoBot | 489+11 | 5.04 MB | 31 Dec 2011 - 02:09 |
Alexa (IA Archiver) | 88+47 | 2.74 MB | 31 Dec 2011 - 01:36 |
SeznamBot | 72+15 | 3.78 MB | 30 Dec 2011 - 23:47 |
Mail.ru bot | 27 | 2.02 MB | 30 Dec 2011 - 22:24 |
Unknown robot (identified by empty user agent string) | 715+9 | 13.26 MB | 30 Dec 2011 - 19:19 |
Unknown robot (identified by 'discovery') | 4,321+25 | 43.70 MB | 30 Dec 2011 - 18:49 |
Findlinks | 10+10 | 165.95 KB | 30 Dec 2011 - 13:58 |
Y!J Yahoo Japan | 141+138 | 919.06 KB | 30 Dec 2011 - 09:26 |
Netcraft | 3 | 11.65 KB | 29 Dec 2011 - 23:16 |
GigaBot | 31+28 | 893.99 KB | 29 Dec 2011 - 23:16 |
Zeus Webster Pro | 2 | 20.50 KB | 29 Dec 2011 - 18:39 |
WallPaper (alias crawlpaper) | 3 | 79.79 KB | 29 Dec 2011 - 11:47 |
Voila | 9+4 | 512.99 KB | 28 Dec 2011 - 23:11 |
Fish search | 1 | 8.40 KB | 27 Dec 2011 - 11:08 |
Cursor | 1 | 11.65 KB | 26 Dec 2011 - 23:00 |
FavIconizer | 3 | 34.96 KB | 26 Dec 2011 - 14:49 |
Speedy Spider | 2,087+179 | 22.90 MB | 25 Dec 2011 - 17:26 |
ichiro | 27+8 | 807.68 KB | 25 Dec 2011 - 05:37 |
Motor | 466 | 4.45 MB | 25 Dec 2011 - 00:50 |
Jakarta commons-httpclient | 14 | 216.24 KB | 23 Dec 2011 - 21:43 |
Unknown robot (identified by 'checker') | 2 | 8.85 KB | 23 Dec 2011 - 01:48 |
Powermarks | 4 | 891.54 KB | 22 Dec 2011 - 23:48 |
Custo | 555+5 | 10.80 MB | 21 Dec 2011 - 15:12 |
psbot | 2,700+74 | 35.93 MB | 21 Dec 2011 - 06:03 |
Web Core / Roots | 32 | 2.85 MB | 15 Dec 2011 - 05:28 |
java\/[0-9] | 25 | 179.38 KB | 14 Dec 2011 - 02:10 |
Harvest | 4 | 73.74 KB | 13 Dec 2011 - 22:01 |
LinkChecker | 2+1 | 8.85 KB | 13 Dec 2011 - 10:49 |
larbin | 62+7 | 1012.35 KB | 12 Dec 2011 - 10:22 |
Heritrix | 5+1 | 89.05 KB | 11 Dec 2011 - 11:27 |
bender focused_crawler | 108+2 | 1.33 MB | 11 Dec 2011 - 10:38 |
legs | 410+31 | 5.87 MB | 10 Dec 2011 - 18:44 |
MOMspider | 1+1 | 0 | 07 Dec 2011 - 16:20 |
HTMLParser | 1 | 8.85 KB | 03 Dec 2011 - 12:02 |
|