 AWStats Report: 2020-2021
| Robots/Spiders visitors | |
| 112 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot identified by bot\* | 22,403+580 | 889.97 MB | 31 Dec 2020 - 17:26 |
| Unknown robot (identified by hit on robots.txt) | 0+20495 | 30.44 MB | 31 Dec 2020 - 23:27 |
| crawl | 18,512+177 | 246.28 MB | 28 Dec 2020 - 22:07 |
| Baidu ( catchall ) | 16,917 | 59.72 MB | 31 Dec 2020 - 20:52 |
| MJ12bot | 13,688+2950 | 188.25 MB | 31 Dec 2020 - 15:25 |
| feed | 14,119 | 169.71 MB | 31 Dec 2020 - 22:17 |
| sitemap | 11,991+15 | 89.92 MB | 22 Dec 2020 - 05:07 |
| CCBot | 9,146+253 | 360.05 MB | 30 Nov 2020 - 22:33 |
| empty user agent string | 7,480+223 | 214.42 MB | 31 Dec 2020 - 18:26 |
| infobot | 3,180+2699 | 42.79 MB | 31 Dec 2020 - 23:55 |
| Firefox version 10 and lower - various robots | 5,187+75 | 84.45 MB | 30 Dec 2020 - 11:16 |
| Apache-HttpClient | 4,809+120 | 69.78 MB | 31 Dec 2020 - 22:04 |
| python | 4,263+101 | 281.57 MB | 31 Dec 2020 - 15:26 |
| nutch ( catchall ) | 3,694+528 | 34.81 MB | 05 Dec 2020 - 00:03 |
| Googlebot-Image | 3,850 | 347.51 MB | 31 Dec 2020 - 23:06 |
| rogerbot | 2+1918 | 2.90 MB | 31 Dec 2020 - 22:28 |
| ltx71 | 526+999 | 9.97 MB | 31 Dec 2020 - 09:27 |
| Dalvik | 1,310 | 1.49 GB | 30 Dec 2020 - 10:47 |
| PhantomJS | 1,088 | 3.92 MB | 24 Dec 2020 - 22:15 |
| MSIE 6 - ( Rogue Robot ) | 932 | 45.35 MB | 30 Dec 2020 - 09:03 |
| DotBot | 0+878 | 1.33 MB | 31 Dec 2020 - 15:00 |
| panscient | 743+95 | 16.61 MB | 25 Nov 2020 - 00:02 |
| favicon | 808 | 6.39 MB | 29 Dec 2020 - 16:56 |
| Validator.nu | 769 | 7.04 MB | 25 Nov 2020 - 06:32 |
| oBot | 476+274 | 1.55 MB | 27 Dec 2020 - 08:43 |
| 360Spider | 579 | 7.19 MB | 27 Dec 2020 - 23:52 |
| W3C_Validator | 564 | 6.09 MB | 27 Dec 2020 - 12:36 |
| twitterbot | 407+150 | 17.33 MB | 19 Nov 2020 - 10:19 |
| link | 163+282 | 2.01 MB | 31 Dec 2020 - 07:35 |
| LinkCheck | 433 | 5.09 MB | 30 Dec 2020 - 17:07 |
| Wget | 349+4 | 36.19 MB | 07 Dec 2020 - 13:39 |
| facebookexternalhit | 311 | 151.25 MB | 30 Dec 2020 - 19:42 |
| Java ( catchall ) | 295+4 | 8.93 MB | 09 Dec 2020 - 21:17 |
| core | 283 | 30.54 MB | 16 Dec 2020 - 12:49 |
| Curl | 266+6 | 2.62 MB | 09 Dec 2020 - 22:50 |
| Jigsaw | 252 | 1.50 MB | 29 Sep 2021 - 14:43 |
| dataprovider.com | 237+9 | 8.20 MB | 27 Dec 2020 - 13:00 |
| wordpress | 236 | 2.53 MB | 30 Dec 2020 - 21:00 |
| Google Web Preview | 203 | 676.24 KB | 24 Nov 2020 - 11:02 |
| Python-urllib | 195+6 | 17.75 MB | 17 Dec 2020 - 14:56 |
| mozilla/5.0 - ( Rogue Robot ) | 173+22 | 1.99 MB | 26 Dec 2020 - 10:21 |
| Screaming Frog SEO Spider | 54+121 | 816.21 KB | 18 Dec 2020 - 13:35 |
| geturl | 106+20 | 1.10 MB | 23 Apr 2021 - 03:33 |
| motor | 124 | 2.50 MB | 20 Dec 2020 - 15:45 |
| custo | 118 | 1.10 MB | 18 Sep 2021 - 10:16 |
| robot | 39+79 | 12.72 MB | 30 Dec 2020 - 04:08 |
| Nautic Expo using Firefox/1.5 | 111 | 841.03 KB | 15 Oct 2020 - 08:04 |
| BingPreview | 106 | 23.72 MB | 18 Sep 2021 - 07:35 |
| ichiro | 80+10 | 3.94 MB | 01 May 2021 - 09:27 |
| libwww-perl | 79 | 905.81 KB | 31 Dec 2020 - 22:46 |
| MixrankBot | 78 | 2.90 MB | 17 Nov 2020 - 18:14 |
| facebook | 71 | 145.88 KB | 14 May 2021 - 13:27 |
| feedvalidator | 69 | 555.82 KB | 30 Dec 2020 - 13:11 |
| Konqueror | 68 | 3.72 MB | 17 Dec 2020 - 07:21 |
| linkbot | 41+27 | 170.76 KB | 25 Dec 2020 - 07:04 |
| CFNetwork | 52 | 2.49 MB | 23 Nov 2020 - 22:36 |
| Yahoo! Slurp | 40+12 | 4.59 MB | 22 Dec 2020 - 18:08 |
| Unknown robot identified by \*bot | 47 | 803.60 KB | 02 Dec 2020 - 06:04 |
| discover | 40 | 403.57 KB | 20 Dec 2020 - 21:13 |
| ping.blo.gs | 35 | 769.76 KB | 19 Sep 2021 - 16:34 |
| Yandex ( catchall ) | 8+26 | 20.98 MB | 09 Aug 2021 - 03:44 |
| synthesio | 34 | 4.02 MB | 16 May 2021 - 20:08 |
| FirePHP | 32 | 77.01 KB | 24 Jun 2021 - 02:42 |
| MSIE 5 - ( Rogue Robot ) | 27 | 275.43 KB | 18 Dec 2020 - 05:53 |
| ips-agent | 18+8 | 147.14 KB | 24 Dec 2020 - 03:15 |
| 2345Explorer | 24 | 12.43 MB | 04 Aug 2021 - 01:45 |
| Mozilla ( Rogue Robot ) | 21 | 981.42 KB | 28 Dec 2020 - 19:49 |
| yacybot | 0+21 | 32.30 KB | 18 Dec 2020 - 08:55 |
| mozilla/4.0 (compatible;) - ( Rogue Robot ) | 19 | 3.39 MB | 21 Dec 2020 - 13:38 |
| Xenu Link Sleuth | 19 | 17.71 KB | 20 Nov 2020 - 19:36 |
| MSIE 4 - ( Rogue Robot ) | 19 | 45.19 KB | 05 Dec 2020 - 16:51 |
| W3C-checklink | 6+12 | 18.20 KB | 22 Sep 2021 - 22:58 |
| smtbot | 16 | 105.22 KB | 21 Dec 2020 - 04:41 |
| TelegramBot | 14 | 13.76 MB | 25 Dec 2020 - 14:06 |
| htmlparser | 14 | 234.09 KB | 22 Dec 2020 - 15:56 |
| riddler | 8+4 | 3.55 MB | 27 Aug 2021 - 18:05 |
| spider | 7+4 | 2.14 MB | 05 Oct 2020 - 13:20 |
| gigablastopensource | 6+5 | 71.23 KB | 13 Oct 2020 - 22:05 |
| Googlebot-Video | 11 | 671 Bytes | 13 Oct 2020 - 05:28 |
| linkchecker | 10 | 0 | 05 Aug 2021 - 00:17 |
| Links ( | 9 | 60.17 KB | 20 Oct 2020 - 13:42 |
| checker | 9 | 118.02 KB | 27 Dec 2020 - 12:15 |
| urllib | 8 | 76.62 KB | 18 Sep 2021 - 09:17 |
| DomainStatsBot | 6+2 | 44.07 KB | 05 Sep 2021 - 23:34 |
| webcopy | 8 | 54.57 KB | 25 Feb 2021 - 23:08 |
| bbot | 4+4 | 44.38 KB | 30 Sep 2021 - 13:24 |
| ICC-Crawler | 2+6 | 30.28 KB | 21 Nov 2020 - 21:59 |
| yahoocachesystem | 7 | 226.95 KB | 09 Dec 2020 - 13:20 |
| SafeDNSBot | 0+7 | 10.96 KB | 29 Dec 2020 - 07:54 |
| Mediatoolkitbot | 4+2 | 45.24 KB | 08 Mar 2021 - 18:52 |
| ELinks | 6 | 23.73 KB | 15 Jul 2021 - 05:52 |
| BingLocalSearch | 2+4 | 42.07 KB | 20 Dec 2020 - 21:08 |
| perl | 6 | 53.33 KB | 08 Mar 2021 - 18:27 |
| Yahoo Link Preview | 5 | 26.06 KB | 30 Apr 2021 - 17:52 |
| sunrise | 4 | 12.11 KB | 21 Sep 2021 - 17:21 |
| commons-httpclient | 4 | 38.31 KB | 09 Apr 2021 - 10:44 |
| crawl/Nutch | 0+4 | 6.07 KB | 20 Aug 2021 - 02:57 |
| anthill | 4 | 28.96 KB | 08 Mar 2021 - 18:41 |
| ng/1. | 4 | 14.38 KB | 05 Sep 2021 - 07:02 |
| Deepnet Explorer | 4 | 16.82 KB | 13 May 2021 - 02:28 |
| GarlikCrawler | 0+4 | 6.27 KB | 19 Nov 2020 - 20:58 |
| ELinks ( | 3 | 39.61 KB | 26 Oct 2020 - 17:40 |
| Windows 99 - ( Rogue Robot ) | 2 | 19.15 KB | 19 May 2021 - 22:21 |
| YisouSpider | 0+2 | 3.03 KB | 01 Sep 2021 - 01:01 |
| simplepie | 2 | 10.65 KB | 05 May 2021 - 05:36 |
| Microsoft Office Protocol Discovery | 2 | 73.84 KB | 28 Feb 2021 - 17:29 |
| titan | 2 | 30.17 KB | 08 Sep 2021 - 20:26 |
| Seobility | 0+2 | 3.09 KB | 05 Feb 2021 - 06:01 |
| cfetch | 1 | 768.25 KB | 12 Oct 2020 - 14:42 |
| Googlebot | 1 | 17.71 KB | 19 Jan 2021 - 22:06 |
| rambler | 1 | 17.71 KB | 01 Jan 2021 - 00:58 |
| Who.is.Bot | 1 | 20.00 KB | 26 Oct 2020 - 04:37 |
| * Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.
Advanced Web Statistics 7.7 (build 20180105) - Created by awstats
 | www.avalanche-center.org |  |
|