| 39 different robots | Hits |
| Inktomi Slurp | 108985+689 |
| Unknown robot (identified by 'crawl') | 29831+1588 |
| LinkScan | 18653 |
| Googlebot | 16144+3 |
| Unknown robot (identified by hit on 'robots.txt') | 0+13203 |
| Unknown robot (identified by 'spider') | 4060+334 |
| Unknown robot (identified by 'robot') | 462+3714 |
| The Python Robot | 651+2232 |
| Turn It In | 2063+7 |
| Voila | 1114+34 |
| Phantom | 475 |
| arks | 372 |
| larbin | 210+6 |
| SurveyBot | 182+26 |
| MSIECrawler | 161 |
| Alexa (IA Archiver) | 2+152 |
| SpiderBot | 44+59 |
| Raven Search | 81 |
| StackRambler | 79 |
| Yandex bot | 70 |
| Checkbot | 42 |
| Tarantula | 40 |
| Web Core / Roots | 15+3 |
| EchO! | 18 |
| LinkChecker | 8+8 |
| Speedy Spider | 8+4 |
| mnoGoSearch search engine software | 6+3 |
| ExactSeek Crawler | 5+3 |
| Pioneer | 8 |
| Motor | 7 |
| WallPaper (alias crawlpaper) | 4 |
| MSNBot | 2+1 |
| BaiDuSpider | 3 |
| JoBo Java Web Robot | 3 |
| UdmSearch | 2 |
| BSpider | 2 |
| churl | 1 |
| XYLEME Robot | 1 |
| Fish search | 1 |