64 different robots | Hits | Bandwidth | Last visit |
bingbot | 2,395,837+631 | 461.90 GB | 31 Dec 2018 - 23:59 |
Unknown robot (identified by 'bot*') | 464,168+6241 | 52.72 GB | 31 Dec 2018 - 23:59 |
Bing Preview bot | 98,295 | 1.46 GB | 31 Dec 2018 - 23:00 |
Yandex bot | 57,509+651 | 2.02 GB | 31 Dec 2018 - 23:41 |
Googlebot | 48,367+67 | 601.10 MB | 31 Dec 2018 - 23:59 |
Unknown robot (identified by 'crawl') | 23,376+322 | 263.90 MB | 31 Dec 2018 - 23:54 |
Unknown robot (identified by empty user agent string) | 20,871+27 | 392.83 MB | 31 Dec 2018 - 23:59 |
Unknown robot (identified by 'spider') | 19,078+8 | 153.78 MB | 31 Dec 2018 - 23:43 |
BaiDuSpider | 12,943+22 | 189.11 MB | 31 Dec 2018 - 23:56 |
Sogou Spider | 11,551+353 | 148.50 MB | 31 Dec 2018 - 23:47 |
MJ12bot | 10,815+447 | 177.18 MB | 31 Dec 2018 - 22:02 |
Exabot | 9,515+52 | 72.82 MB | 31 Dec 2018 - 23:43 |
Unknown robot (identified by 'robot') | 5,665+73 | 75.09 MB | 31 Dec 2018 - 23:58 |
yeti | 3,713+33 | 46.24 MB | 31 Dec 2018 - 23:56 |
Python-urllib | 3,089 | 37.59 MB | 31 Dec 2018 - 16:24 |
FaceBook bot | 2,596+12 | 60.30 MB | 31 Dec 2018 - 23:49 |
Mail.ru bot | 1,637+621 | 22.76 MB | 31 Dec 2018 - 23:17 |
Unknown robot (identified by hit on 'robots.txt') | 0+2022 | 0 | 31 Dec 2018 - 22:04 |
Alexa (IA Archiver) | 1,279+29 | 13.58 MB | 31 Dec 2018 - 11:44 |
Sift | 414 | 2.79 MB | 31 Dec 2018 - 01:09 |
A PHP script | 388 | 5.52 MB | 31 Dec 2018 - 22:30 |
Feedfetcher-Google | 361 | 1.91 MB | 31 Dec 2018 - 23:44 |
Web Core / Roots | 215 | 4.57 MB | 31 Dec 2018 - 15:42 |
FavIconizer | 201 | 2.07 MB | 31 Dec 2018 - 11:46 |
WGet tools | 189 | 2.52 MB | 31 Dec 2018 - 19:27 |
SeznamBot | 72+68 | 1.05 MB | 31 Dec 2018 - 22:18 |
Unknown robot (identified by 'discovery') | 130 | 0 | 31 Dec 2018 - 08:08 |
GigaBot | 104+10 | 4.13 MB | 31 Dec 2018 - 12:25 |
ichiro | 89+11 | 1.80 MB | 30 Dec 2018 - 16:31 |
MojeekBot | 38+35 | 291.30 KB | 31 Dec 2018 - 13:49 |
Additional Yahoo bots. | 72 | 1.66 MB | 31 Dec 2018 - 23:08 |
WebCollage | 54 | 2.30 MB | 30 Dec 2018 - 23:32 |
LinkBot | 46 | 1.06 MB | 27 Dec 2018 - 19:57 |
ScoutJet crawler for Blekko. | 23+20 | 210.04 KB | 31 Dec 2018 - 20:04 |
Java (Often spam bot) | 35 | 446.49 KB | 31 Dec 2018 - 05:00 |
Nutch | 27+5 | 1004.15 KB | 11 Dec 2018 - 18:08 |
Phantom | 30 | 178.83 KB | 13 Dec 2018 - 02:37 |
Drupal Site | 28 | 0 | 31 Dec 2018 - 15:35 |
Shoutcast Directory Service | 28 | 222.33 KB | 31 Dec 2018 - 05:11 |
CFNetwork | 25 | 515.25 KB | 29 Dec 2018 - 21:21 |
WordPress | 22 | 46.76 KB | 31 Dec 2018 - 12:56 |
Common *nix tool for automating web document retireval. Most likely a bot. | 15 | 173.52 KB | 31 Dec 2018 - 20:49 |
Perl tool | 12 | 1.79 MB | 30 Dec 2018 - 00:35 |
Yahoo Slurp | 5+7 | 39.70 KB | 31 Dec 2018 - 19:22 |
Turn It In | 1+8 | 29.44 KB | 23 Dec 2018 - 14:30 |
Suspected bot masqurading as Mozilla | 9 | 87.23 KB | 31 Dec 2018 - 03:47 |
yacy | 6+2 | 55.74 KB | 25 Dec 2018 - 00:49 |
Powermarks | 7 | 253.42 KB | 27 Dec 2018 - 10:25 |
Netcraft | 6 | 7.94 KB | 31 Dec 2018 - 09:42 |
Unknown robot (identified by '*bot') | 1+4 | 7.94 KB | 27 Dec 2018 - 10:43 |
Jakarta commons-httpclient | 4 | 31.76 KB | 31 Dec 2018 - 20:40 |
MSNBot | 4 | 29.38 KB | 28 Dec 2018 - 10:24 |
archive.org bot | 0+4 | 0 | 30 Dec 2018 - 18:26 |
TITAN | 3 | 113.62 KB | 27 Dec 2018 - 05:12 |
microsoft-webdav-miniredir | 2 | 0 | 12 Dec 2018 - 04:32 |
proximic | 0+2 | 0 | 23 Dec 2018 - 21:11 |
twitterbot | 1+1 | 30.54 KB | 25 Dec 2018 - 20:25 |
Motor | 1 | 26.46 KB | 02 Dec 2018 - 22:58 |
StackRambler | 1 | 7.94 KB | 04 Dec 2018 - 09:40 |
JoBo Java Web Robot | 1 | 87.05 KB | 07 Dec 2018 - 16:16 |
InternetArchive | 1 | 0 | 30 Dec 2018 - 11:42 |
ning | 1 | 12.99 KB | 06 Dec 2018 - 17:00 |
DragonBot | 1 | 7.94 KB | 01 Dec 2018 - 12:18 |
Others | 0 | 29 Bytes | |
|