| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| Sogou Spider | 4,616+12 | 66.45 MB | 31 Jan 2012 - 23:59 |
| Googlebot | 93,366+93 | 1.33 GB | 31 Jan 2012 - 23:59 |
| java\/[0-9] | 119 | 12.06 MB | 31 Jan 2012 - 23:59 |
| Unknown robot (identified by 'crawl') | 14,993+32 | 158.73 MB | 31 Jan 2012 - 23:58 |
| Yandex bot | 21,449+81 | 313.21 MB | 31 Jan 2012 - 23:58 |
| BaiDuSpider | 19,144+72 | 194.65 MB | 31 Jan 2012 - 23:57 |
| Unknown robot (identified by 'bot*') | 40,774+1654 | 577.32 MB | 31 Jan 2012 - 23:57 |
| MSNBot-media | 27,864+3946 | 598.29 MB | 31 Jan 2012 - 23:54 |
| Unknown robot (identified by 'discovery') | 2,528+42 | 32.65 MB | 31 Jan 2012 - 23:48 |
| Unknown robot (identified by hit on 'robots.txt') | 0+488 | 0 | 31 Jan 2012 - 23:31 |
| Feedfetcher-Google | 245 | 2.10 MB | 31 Jan 2012 - 23:19 |
| Unknown robot (identified by '*bot') | 15,559+576 | 158.65 MB | 31 Jan 2012 - 22:47 |
| FaceBook bot | 938 | 12.58 MB | 31 Jan 2012 - 22:38 |
| Alexa (IA Archiver) | 57+49 | 503.46 KB | 31 Jan 2012 - 22:23 |
| Unknown robot (identified by empty user agent string) | 354+4 | 9.53 MB | 31 Jan 2012 - 22:14 |
| OutfoxBot/YodaoBot | 221 | 2.51 MB | 31 Jan 2012 - 22:12 |
| Yahoo Slurp | 1,314+76 | 15.45 MB | 31 Jan 2012 - 21:54 |
| CFNetwork | 63 | 1.49 MB | 31 Jan 2012 - 21:20 |
| MJ12bot | 2,427+152 | 53.81 MB | 31 Jan 2012 - 20:24 |
| WebCollage | 874 | 29.14 MB | 31 Jan 2012 - 19:57 |
| Unknown robot (identified by 'spider') | 691+27 | 9.26 MB | 31 Jan 2012 - 18:19 |
| Nutch | 801+93 | 19.11 MB | 31 Jan 2012 - 17:53 |
| BSpider | 127+28 | 6.28 MB | 31 Jan 2012 - 17:07 |
| Unknown robot (identified by 'robot') | 5,604+28 | 45.83 MB | 31 Jan 2012 - 15:30 |
| GigaBot | 9+9 | 109.30 KB | 31 Jan 2012 - 12:55 |
| Speedy Spider | 235+62 | 4.02 MB | 31 Jan 2012 - 12:54 |
| Exabot | 78+17 | 1.16 MB | 31 Jan 2012 - 12:44 |
| Powermarks | 5 | 1.62 MB | 31 Jan 2012 - 12:22 |
| MSNBot | 92,363+8 | 925.14 MB | 31 Jan 2012 - 12:13 |
| ichiro | 29+7 | 1.46 MB | 31 Jan 2012 - 11:40 |
| Unknown robot (identified by 'checker') | 3 | 0 | 31 Jan 2012 - 11:27 |
| SeznamBot | 84+12 | 3.61 MB | 31 Jan 2012 - 11:21 |
| psbot | 1,317+65 | 8.75 MB | 31 Jan 2012 - 04:56 |
| Mail.ru bot | 39+2 | 2.23 MB | 31 Jan 2012 - 03:49 |
| archive.org bot | 31+10 | 300.54 KB | 30 Jan 2012 - 10:33 |
| Google AdSense | 3 | 20.68 KB | 30 Jan 2012 - 09:59 |
| Findlinks | 9+13 | 167.93 KB | 30 Jan 2012 - 05:31 |
| Web Core / Roots | 99 | 9.82 MB | 30 Jan 2012 - 04:46 |
| WordPress | 71 | 667.18 KB | 30 Jan 2012 - 00:51 |
| WGet tools | 436 | 16.52 MB | 29 Jan 2012 - 11:41 |
| WallPaper (alias crawlpaper) | 11 | 242.25 KB | 29 Jan 2012 - 08:38 |
| Voila | 7+5 | 398.99 KB | 29 Jan 2012 - 07:03 |
| Perl tool | 38 | 230.81 KB | 28 Jan 2012 - 21:27 |
| Netcraft | 2 | 0 | 27 Jan 2012 - 15:22 |
| Jakarta commons-httpclient | 1 | 6.42 KB | 27 Jan 2012 - 12:26 |
| Y!J Yahoo Japan | 131+129 | 867.30 KB | 26 Jan 2012 - 19:49 |
| T-H-U-N-D-E-R-S-T-O-N-E | 1 | 11.65 KB | 25 Jan 2012 - 12:26 |
| Fish search | 2 | 14.75 KB | 25 Jan 2012 - 09:15 |
| Python-urllib | 88 | 12.91 MB | 24 Jan 2012 - 02:49 |
| Heritrix | 28+2 | 404.12 KB | 23 Jan 2012 - 01:30 |
| Motor | 51 | 650.67 KB | 21 Jan 2012 - 01:09 |
| larbin | 18+5 | 486.97 KB | 19 Jan 2012 - 20:11 |
| FavIconizer | 3 | 34.96 KB | 19 Jan 2012 - 19:07 |
| yacy | 19+13 | 1.74 MB | 19 Jan 2012 - 04:49 |
| bender focused_crawler | 148+4 | 6.96 MB | 16 Jan 2012 - 08:47 |
| FeedCrawl by feed@aobo.com | 9 | 0 | 13 Jan 2012 - 00:36 |
| MSIECrawler | 1 | 32.17 KB | 12 Jan 2012 - 17:51 |
| MOMspider | 1+1 | 0 | 07 Jan 2012 - 14:52 |
| Susie | 1 | 57.00 KB | 04 Jan 2012 - 10:22 |
| Others | 0 | 0 | |
|