| 70 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 807,530+252 | 122.39 GB | 31 Dec 2016 - 23:59 |
| Googlebot | 111,398+143 | 1.88 GB | 31 Dec 2016 - 23:59 |
| Yahoo Slurp | 70,527+83 | 809.86 MB | 31 Dec 2016 - 23:59 |
| BaiDuSpider | 63,965+25 | 837.14 MB | 31 Dec 2016 - 23:59 |
| Yandex bot | 1,171,425+277 | 244.44 GB | 31 Dec 2016 - 23:59 |
| Unknown robot (identified by 'robot') | 2,710+50 | 32.50 MB | 31 Dec 2016 - 23:58 |
| Mail.ru bot | 8,886+102 | 154.24 MB | 31 Dec 2016 - 23:57 |
| Unknown robot (identified by 'bot*') | 82,645+2123 | 931.81 MB | 31 Dec 2016 - 23:54 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1479 | 0 | 31 Dec 2016 - 23:52 |
| Web Core / Roots | 587 | 16.89 MB | 31 Dec 2016 - 23:51 |
| MSNBot-media | 6,560 | 127.85 MB | 31 Dec 2016 - 23:50 |
| yeti | 381+16 | 9.19 MB | 31 Dec 2016 - 23:41 |
| FavIconizer | 380 | 6.88 MB | 31 Dec 2016 - 23:35 |
| Unknown robot (identified by 'spider') | 12,371+3 | 100.15 MB | 31 Dec 2016 - 23:29 |
| SeznamBot | 2,229+214 | 33.05 MB | 31 Dec 2016 - 23:25 |
| Feedfetcher-Google | 1,525 | 18.43 MB | 31 Dec 2016 - 23:23 |
| MJ12bot | 4,123+258 | 43.31 MB | 31 Dec 2016 - 23:16 |
| Bing Preview bot | 3,333 | 60.59 MB | 31 Dec 2016 - 23:02 |
| MojeekBot | 83+71 | 3.29 MB | 31 Dec 2016 - 22:14 |
| Sift | 29 | 243.74 KB | 31 Dec 2016 - 22:12 |
| FaceBook bot | 2,462 | 50.89 MB | 31 Dec 2016 - 21:14 |
| Sogou Spider | 11,214+94 | 106.24 MB | 31 Dec 2016 - 21:11 |
| Python-urllib | 2,060+2 | 33.08 MB | 31 Dec 2016 - 20:25 |
| Alexa (IA Archiver) | 70+19 | 1.64 MB | 31 Dec 2016 - 19:12 |
| archive.org bot | 187+62 | 2.68 MB | 31 Dec 2016 - 19:06 |
| Unknown robot (identified by empty user agent string) | 1,165+10 | 17.41 MB | 31 Dec 2016 - 19:01 |
| Exabot | 1,972+32 | 13.65 MB | 31 Dec 2016 - 18:30 |
| LinkBot | 15 | 143.25 KB | 31 Dec 2016 - 17:51 |
| Unknown robot (identified by 'crawl') | 44,350+174 | 495.12 MB | 31 Dec 2016 - 17:40 |
| WordPress | 111 | 128.77 KB | 31 Dec 2016 - 15:53 |
| arks | 1 | 15.11 KB | 31 Dec 2016 - 12:28 |
| A PHP script | 328 | 4.64 MB | 31 Dec 2016 - 12:00 |
| WGet tools | 46 | 701.10 KB | 31 Dec 2016 - 11:52 |
| Additional Yahoo bots. | 45 | 1.11 MB | 31 Dec 2016 - 10:48 |
| Unknown robot (identified by 'discovery') | 574 | 15.31 KB | 31 Dec 2016 - 09:56 |
| Custo | 2,772 | 24.25 MB | 31 Dec 2016 - 09:00 |
| ScoutJet crawler for Blekko. | 22+20 | 413.98 KB | 31 Dec 2016 - 05:43 |
| Unknown robot (identified by 'checker') | 6 | 0 | 30 Dec 2016 - 19:23 |
| twitterbot | 86+52 | 1.24 MB | 30 Dec 2016 - 16:02 |
| Turn It In | 2+8 | 61.41 KB | 30 Dec 2016 - 11:23 |
| Suspected bot masqurading as Mozilla | 2+1 | 22.93 KB | 30 Dec 2016 - 07:34 |
| WebCollage | 59 | 1.59 MB | 30 Dec 2016 - 01:25 |
| Jakarta commons-httpclient | 10 | 83.58 KB | 29 Dec 2016 - 22:25 |
| NG 1.x (Exalead) | 2 | 11.59 KB | 29 Dec 2016 - 18:36 |
| metauri | 2 | 19.38 KB | 29 Dec 2016 - 17:32 |
| LinkWalker | 0+1 | 0 | 29 Dec 2016 - 16:11 |
| MSNBot | 1 | 6.45 KB | 29 Dec 2016 - 15:03 |
| CFNetwork | 32 | 532.33 KB | 28 Dec 2016 - 19:13 |
| Java (Often spam bot) | 28+6 | 531.89 KB | 28 Dec 2016 - 09:59 |
| yacy | 0+2 | 0 | 27 Dec 2016 - 15:54 |
| youdao | 9 | 137.24 KB | 26 Dec 2016 - 20:35 |
| Drupal Site | 12 | 0 | 25 Dec 2016 - 12:42 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 29 | 154.97 KB | 24 Dec 2016 - 11:10 |
| regator | 2 | 0 | 23 Dec 2016 - 16:08 |
| WallPaper (alias crawlpaper) | 1 | 16.76 KB | 22 Dec 2016 - 23:03 |
| Nutch | 5+6 | 33.47 KB | 22 Dec 2016 - 05:41 |
| UniversalFeedParser | 7 | 42.92 KB | 22 Dec 2016 - 05:10 |
| ichiro | 28+5 | 687.36 KB | 17 Dec 2016 - 15:16 |
| Spiderman | 1 | 8.36 KB | 14 Dec 2016 - 16:04 |
| yie8 | 3 | 54.42 KB | 14 Dec 2016 - 08:31 |
| VSE | 1+1 | 8.36 KB | 12 Dec 2016 - 19:27 |
| Perl tool | 3 | 25.09 KB | 12 Dec 2016 - 13:25 |
| XYLEME Robot | 29 | 304.19 KB | 12 Dec 2016 - 09:54 |
| Sunrise | 27 | 274.14 KB | 12 Dec 2016 - 01:57 |
| Netcraft | 5 | 8.36 KB | 10 Dec 2016 - 19:38 |
| ning | 1 | 15.30 KB | 08 Dec 2016 - 14:40 |
| MOMspider | 1+1 | 0 | 07 Dec 2016 - 19:29 |
| Phantom | 12 | 182.16 KB | 07 Dec 2016 - 05:05 |
| Google AdSense | 13 | 95.44 KB | 05 Dec 2016 - 01:55 |
| StackRambler | 21 | 187.79 KB | 01 Dec 2016 - 20:32 |
| Others | 0 | 0 | |
|