54 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'spider') | 192,511+18 | 1.31 GB | 31 May 2011 - 23:59 |
Googlebot | 73,623+70 | 875.84 MB | 31 May 2011 - 23:59 |
Yahoo Slurp | 52,546+132 | 599.84 MB | 31 May 2011 - 23:57 |
Yandex bot | 28,499+107 | 297.54 MB | 31 May 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 24,055+666 | 326.84 MB | 31 May 2011 - 23:55 |
Unknown robot (identified by 'crawl') | 20,042+170 | 234.66 MB | 31 May 2011 - 21:28 |
Unknown robot (identified by 'robot') | 8,615+24 | 54.90 MB | 31 May 2011 - 05:55 |
Unknown robot (identified by '*bot') | 6,936+266 | 47.02 MB | 31 May 2011 - 23:49 |
Unknown robot (identified by 'discovery') | 4,579+854 | 33.47 MB | 31 May 2011 - 23:57 |
Motor | 5,329 | 76.11 MB | 31 May 2011 - 16:16 |
MSNBot-media | 3,767+1096 | 76.20 MB | 31 May 2011 - 23:44 |
WebCollage | 2,581 | 46.88 MB | 25 May 2011 - 19:34 |
Speedy Spider | 1,937+288 | 23.10 MB | 31 May 2011 - 23:30 |
MJ12bot | 1,723+82 | 46.00 MB | 31 May 2011 - 12:38 |
Custo | 1,769+9 | 20.85 MB | 30 May 2011 - 12:27 |
BaiDuSpider | 1,505+37 | 19.62 MB | 31 May 2011 - 23:31 |
Unknown robot (identified by empty user agent string) | 1,284+83 | 19.42 MB | 31 May 2011 - 16:56 |
ichiro | 887+30 | 22.95 MB | 27 May 2011 - 02:33 |
Exabot | 371+37 | 3.13 MB | 31 May 2011 - 23:37 |
Unknown robot (identified by hit on 'robots.txt') | 0+398 | 0 | 31 May 2011 - 15:51 |
FaceBook bot | 338 | 5.27 MB | 30 May 2011 - 21:28 |
bender focused_crawler | 249+85 | 5.98 MB | 25 May 2011 - 05:08 |
psbot | 261+60 | 1.13 MB | 31 May 2011 - 12:14 |
Feedfetcher-Google | 248 | 2.15 MB | 31 May 2011 - 22:54 |
VORTEX | 233 | 3.31 MB | 25 May 2011 - 18:10 |
OutfoxBot/YodaoBot | 195 | 2.22 MB | 31 May 2011 - 20:20 |
Turn It In | 190+1 | 4.20 MB | 11 May 2011 - 13:26 |
Sogou Spider | 102+14 | 3.46 MB | 31 May 2011 - 14:52 |
Web Core / Roots | 95 | 8.99 MB | 31 May 2011 - 16:56 |
Alexa (IA Archiver) | 61+32 | 2.68 MB | 31 May 2011 - 05:47 |
legs | 79+8 | 522.27 KB | 24 May 2011 - 00:53 |
WordPress | 60 | 200.74 KB | 31 May 2011 - 09:25 |
Ask | 24+12 | 947.30 KB | 31 May 2011 - 15:20 |
CFNetwork | 35 | 974.02 KB | 29 May 2011 - 17:33 |
Findlinks | 20+13 | 455.86 KB | 31 May 2011 - 20:16 |
Nutch | 18+11 | 405.75 KB | 29 May 2011 - 15:22 |
BSpider | 14+5 | 151.36 KB | 27 May 2011 - 19:10 |
GigaBot | 9+5 | 436.48 KB | 31 May 2011 - 14:45 |
Perl tool | 13 | 72.41 KB | 27 May 2011 - 21:44 |
Voila | 8+4 | 455.99 KB | 28 May 2011 - 10:16 |
Python-urllib | 8 | 114.37 KB | 31 May 2011 - 19:36 |
java\/[0-9] | 6 | 25.58 KB | 21 May 2011 - 20:10 |
Netcraft | 6 | 23.30 KB | 28 May 2011 - 12:58 |
Heritrix | 1+4 | 14.62 KB | 22 May 2011 - 06:53 |
Mail.ru bot | 3+1 | 19.20 KB | 28 May 2011 - 07:11 |
WGet tools | 4 | 58.09 KB | 25 May 2011 - 05:33 |
WallPaper (alias crawlpaper) | 3 | 37.14 KB | 06 May 2011 - 22:44 |
The web archive (IA Archiver) | 0+2 | 0 | 10 May 2011 - 05:37 |
archive.org bot | 1+1 | 64.85 KB | 14 May 2011 - 00:27 |
larbin | 1+1 | 11.65 KB | 12 May 2011 - 00:50 |
Powermarks | 1 | 11.65 KB | 08 May 2011 - 17:18 |
EasyDL | 1 | 11.65 KB | 15 May 2011 - 08:51 |
Unknown robot (identified by 'checker') | 1 | 8.85 KB | 01 May 2011 - 03:37 |
MSIECrawler | 1 | 17.04 KB | 20 May 2011 - 10:27 |
|