| 66 different robots | Hits | Bandwidth | Last visit |
|---|
| bingbot | 5,883,887+121 | 1212.68 GB | 30 Nov 2017 - 23:59 |
| Unknown robot (identified by 'bot*') | 453,505+5643 | 21.12 GB | 30 Nov 2017 - 23:59 |
| Yandex bot | 303,570+918 | 46.62 GB | 30 Nov 2017 - 23:59 |
| Unknown robot (identified by 'robot') | 163,531+32 | 1.75 GB | 30 Nov 2017 - 23:59 |
| Googlebot | 104,979+112 | 1.18 GB | 30 Nov 2017 - 23:59 |
| Bing Preview bot | 93,522 | 1.20 GB | 30 Nov 2017 - 23:48 |
| Unknown robot (identified by 'crawl') | 49,198+189 | 554.72 MB | 28 Nov 2017 - 23:40 |
| BaiDuSpider | 36,668+29 | 591.56 MB | 30 Nov 2017 - 23:59 |
| Unknown robot (identified by 'spider') | 33,108+2 | 259.58 MB | 30 Nov 2017 - 23:59 |
| Yahoo Slurp | 17,743+148 | 214.29 MB | 30 Nov 2017 - 23:59 |
| Sogou Spider | 9,792+520 | 259.65 MB | 30 Nov 2017 - 23:32 |
| ScoutJet crawler for Blekko. | 6,181+1052 | 82.37 MB | 30 Nov 2017 - 23:55 |
| Unknown robot (identified by empty user agent string) | 4,432+11 | 130.41 MB | 30 Nov 2017 - 22:09 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3328 | 0 | 30 Nov 2017 - 23:34 |
| FaceBook bot | 2,698 | 70.40 MB | 30 Nov 2017 - 21:58 |
| Unknown robot (identified by '*bot') | 2,283+6 | 40.61 MB | 25 Nov 2017 - 10:36 |
| Python-urllib | 1,548+3 | 23.88 MB | 30 Nov 2017 - 21:59 |
| yeti | 1,372+31 | 20.26 MB | 30 Nov 2017 - 23:50 |
| Mail.ru bot | 1,034+367 | 7.61 MB | 30 Nov 2017 - 02:37 |
| Exabot | 1,016+4 | 8.81 MB | 30 Nov 2017 - 23:18 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 960 | 12.29 MB | 29 Nov 2017 - 02:45 |
| MJ12bot | 741+194 | 37.00 MB | 30 Nov 2017 - 20:59 |
| WGet tools | 824 | 18.15 MB | 29 Nov 2017 - 19:18 |
| Alexa (IA Archiver) | 605+132 | 20.15 MB | 30 Nov 2017 - 21:26 |
| FavIconizer | 579 | 13.22 MB | 30 Nov 2017 - 23:20 |
| psbot | 550+19 | 5.45 MB | 30 Nov 2017 - 23:59 |
| Sift | 508 | 5.04 MB | 30 Nov 2017 - 23:44 |
| SeznamBot | 260+221 | 4.87 MB | 30 Nov 2017 - 21:28 |
| WebCopy | 406 | 1.74 MB | 07 Nov 2017 - 19:33 |
| Feedfetcher-Google | 338 | 2.47 MB | 30 Nov 2017 - 23:13 |
| A PHP script | 323 | 4.57 MB | 30 Nov 2017 - 21:24 |
| Additional Yahoo bots. | 303 | 7.41 MB | 30 Nov 2017 - 16:22 |
| Java (Often spam bot) | 261+26 | 2.58 MB | 30 Nov 2017 - 23:16 |
| Phantom | 228 | 3.65 MB | 30 Nov 2017 - 02:28 |
| WebCollage | 208 | 6.94 MB | 30 Nov 2017 - 19:41 |
| Unknown robot (identified by 'discovery') | 125 | 149.58 KB | 30 Nov 2017 - 03:56 |
| Web Core / Roots | 118 | 8.98 MB | 30 Nov 2017 - 18:31 |
| MojeekBot | 43+41 | 1.21 MB | 30 Nov 2017 - 20:04 |
| ichiro | 58+8 | 1.03 MB | 27 Nov 2017 - 00:46 |
| WordPress | 50 | 231.96 KB | 25 Nov 2017 - 07:30 |
| fido | 28 | 348.83 KB | 10 Nov 2017 - 20:11 |
| twitterbot | 18+7 | 307.07 KB | 29 Nov 2017 - 15:22 |
| CFNetwork | 21+1 | 436.05 KB | 29 Nov 2017 - 22:38 |
| Drupal Site | 15 | 16.99 KB | 30 Nov 2017 - 00:13 |
| proximic | 3+7 | 26.16 KB | 28 Nov 2017 - 13:10 |
| Nutch | 5+5 | 133.46 KB | 29 Nov 2017 - 03:47 |
| yacy | 2+8 | 17.65 KB | 29 Nov 2017 - 11:41 |
| Suspected bot masqurading as Mozilla | 8+1 | 52.94 KB | 22 Nov 2017 - 07:29 |
| Unknown robot (identified by 'scanner') | 5+1 | 74.15 KB | 28 Nov 2017 - 06:21 |
| coldfusion | 6 | 48.35 KB | 29 Nov 2017 - 16:57 |
| Turn It In | 2+3 | 83.87 KB | 13 Nov 2017 - 18:00 |
| Perl tool | 5 | 44.12 KB | 29 Nov 2017 - 08:14 |
| metauri | 5 | 11.34 KB | 14 Nov 2017 - 10:55 |
| Jakarta commons-httpclient | 4 | 35.29 KB | 27 Nov 2017 - 20:00 |
| LinkBot | 3+1 | 13.60 KB | 21 Nov 2017 - 06:23 |
| Netcraft | 4 | 8.82 KB | 11 Nov 2017 - 14:05 |
| Powermarks | 3 | 163.74 KB | 24 Nov 2017 - 12:00 |
| microsoft-webdav-miniredir | 3 | 0 | 29 Nov 2017 - 06:42 |
| Custo | 3 | 31.99 KB | 27 Nov 2017 - 05:17 |
| HTTrack off-line browser | 3 | 91.16 KB | 17 Nov 2017 - 19:28 |
| Unknown robot (identified by 'checker') | 1+2 | 8.82 KB | 05 Nov 2017 - 13:46 |
| UniversalFeedParser | 2 | 85.91 KB | 29 Nov 2017 - 00:14 |
| youdao | 2 | 36.75 KB | 20 Nov 2017 - 01:54 |
| Suspected bot masqurading as Mozilla | 2 | 34 Bytes | 30 Nov 2017 - 09:40 |
| archive.org bot | 0+1 | 0 | 22 Nov 2017 - 21:10 |
| Others | 0 | 3.00 KB | |
|