| 63 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 5,068,559+147 | 1042.55 GB | 31 Dec 2017 - 23:59 |
| Yandex bot | 981,367+1403 | 190.03 GB | 31 Dec 2017 - 23:59 |
| Unknown robot (identified by 'bot*') | 681,165+5069 | 163.72 GB | 31 Dec 2017 - 23:59 |
| Unknown robot (identified by 'robot') | 175,597+40 | 1.98 GB | 31 Dec 2017 - 23:29 |
| Unknown robot (identified by 'spider') | 88,200+4 | 645.14 MB | 31 Dec 2017 - 23:59 |
| Googlebot | 86,624+131 | 926.20 MB | 31 Dec 2017 - 23:59 |
| Bing Preview bot | 32,245 | 744.21 MB | 31 Dec 2017 - 23:52 |
| BaiDuSpider | 26,332+5 | 298.74 MB | 31 Dec 2017 - 23:58 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 25,441 | 146.06 MB | 31 Dec 2017 - 23:32 |
| Unknown robot (identified by 'crawl') | 20,477+360 | 277.89 MB | 30 Dec 2017 - 11:59 |
| Yahoo Slurp | 20,186+158 | 258.78 MB | 31 Dec 2017 - 23:58 |
| Sogou Spider | 11,857+1099 | 294.17 MB | 31 Dec 2017 - 23:42 |
| ScoutJet crawler for Blekko. | 11,539+1375 | 146.69 MB | 31 Dec 2017 - 23:59 |
| yeti | 5,262+29 | 79.46 MB | 31 Dec 2017 - 23:34 |
| Unknown robot (identified by empty user agent string) | 4,615+14 | 147.39 MB | 31 Dec 2017 - 21:00 |
| Exabot | 2,724+39 | 23.66 MB | 31 Dec 2017 - 22:59 |
| Web Core / Roots | 2,235 | 46.39 MB | 31 Dec 2017 - 19:29 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1966 | 0 | 31 Dec 2017 - 23:48 |
| FaceBook bot | 1,730 | 37.29 MB | 31 Dec 2017 - 23:50 |
| Python-urllib | 1,597+4 | 24.44 MB | 31 Dec 2017 - 17:07 |
| WGet tools | 1,525 | 26.38 MB | 31 Dec 2017 - 09:18 |
| Mail.ru bot | 937+245 | 13.84 MB | 31 Dec 2017 - 12:06 |
| MJ12bot | 481+193 | 18.87 MB | 31 Dec 2017 - 18:46 |
| Alexa (IA Archiver) | 551+111 | 8.10 MB | 31 Dec 2017 - 22:10 |
| SeznamBot | 328+244 | 4.93 MB | 31 Dec 2017 - 22:36 |
| FavIconizer | 500 | 10.69 MB | 31 Dec 2017 - 22:34 |
| Sift | 496 | 5.61 MB | 31 Dec 2017 - 21:27 |
| A PHP script | 320 | 4.47 MB | 31 Dec 2017 - 20:37 |
| Feedfetcher-Google | 281 | 1.15 MB | 31 Dec 2017 - 23:53 |
| Java (Often spam bot) | 234+27 | 3.68 MB | 31 Dec 2017 - 18:01 |
| Phantom | 255 | 4.08 MB | 31 Dec 2017 - 21:14 |
| Additional Yahoo bots. | 150 | 3.74 MB | 31 Dec 2017 - 22:09 |
| MojeekBot | 65+53 | 2.25 MB | 31 Dec 2017 - 08:06 |
| WebCollage | 94 | 3.77 MB | 29 Dec 2017 - 16:14 |
| Unknown robot (identified by 'discovery') | 78 | 413.29 KB | 31 Dec 2017 - 19:22 |
| psbot | 62+2 | 461.91 KB | 13 Dec 2017 - 11:28 |
| CFNetwork | 59 | 930.91 KB | 29 Dec 2017 - 06:18 |
| WordPress | 55 | 104.04 KB | 26 Dec 2017 - 19:36 |
| proximic | 10+5 | 170.95 KB | 31 Dec 2017 - 20:11 |
| ichiro | 12+3 | 137.03 KB | 30 Dec 2017 - 08:14 |
| Nutch | 7+7 | 145.12 KB | 31 Dec 2017 - 21:44 |
| twitterbot | 7+4 | 83.62 KB | 19 Dec 2017 - 03:06 |
| Powermarks | 8 | 327.47 KB | 28 Dec 2017 - 13:30 |
| Drupal Site | 7 | 0 | 28 Dec 2017 - 14:49 |
| microsoft-webdav-miniredir | 6 | 0 | 22 Dec 2017 - 03:10 |
| Turn It In | 2+4 | 36.82 KB | 15 Dec 2017 - 19:48 |
| Unknown robot (identified by '*bot') | 4+1 | 56.49 KB | 09 Dec 2017 - 05:28 |
| archive.org bot | 0+5 | 0 | 18 Dec 2017 - 02:29 |
| Jakarta commons-httpclient | 4 | 35.26 KB | 25 Dec 2017 - 19:55 |
| Suspected bot masqurading as Mozilla | 3+1 | 26.44 KB | 21 Dec 2017 - 02:31 |
| youdao | 4 | 62.37 KB | 28 Dec 2017 - 04:07 |
| Suspected bot masqurading as Mozilla | 4 | 86 Bytes | 30 Dec 2017 - 12:56 |
| LinkBot | 2+1 | 6.14 KB | 01 Dec 2017 - 22:48 |
| Perl tool | 3 | 17.65 KB | 14 Dec 2017 - 22:11 |
| Unknown robot (identified by 'scanner') | 1+1 | 9.65 KB | 22 Dec 2017 - 22:38 |
| Netcraft | 2 | 8.82 KB | 06 Dec 2017 - 23:00 |
| TITAN | 1 | 12.68 KB | 30 Dec 2017 - 00:59 |
| yie8 | 1 | 16.67 KB | 11 Dec 2017 - 20:46 |
| Heritrix | 0+1 | 0 | 11 Dec 2017 - 22:41 |
| Unknown robot (identified by 'checker') | 1 | 0 | 26 Dec 2017 - 22:28 |
| Fish search | 1 | 13.07 KB | 21 Dec 2017 - 12:03 |
| Others | 0 | 2 Bytes | |
|