| 40 different robots | Hits |
| Inktomi Slurp | 280153+4203 |
| Unknown robot (identified by 'crawl') | 207396+3275 |
| Voyager | 55819 |
| Voila | 19497+1028 |
| LinkScan | 9179 |
| Unknown robot (identified by 'robot') | 8676+467 |
| Unknown robot (identified by hit on 'robots.txt') | 0+8345 |
| arks | 6942 |
| MSIECrawler | 4174+58 |
| Googlebot | 3968+14 |
| Motor | 3207 |
| Turn It In | 2355+6 |
| legs | 912+394 |
| BBot | 546+16 |
| LinkWalker | 490+2 |
| The Python Robot | 332+74 |
| SurveyBot | 217+31 |
| larbin | 129+86 |
| Alexa (IA Archiver) | 1+160 |
| Unknown robot (identified by 'spider') | 123+19 |
| StackRambler | 43+35 |
| Web Core / Roots | 51+1 |
| Holmes | 9+28 |
| AskJeeves | 17+9 |
| Fish search | 15 |
| InfoSeek Robot 1.0 | 11 |
| LinkChecker | 10 |
| UCSD Crawl | 9 |
| TITAN | 8 |
| mnoGoSearch search engine software | 8 |
| XGET | 7 |
| Netcraft | 6 |
| DNAbot | 2+1 |
| InternetSeer | 3 |
| WallPaper (alias crawlpaper) | 2 |
| Scooter | 0+2 |
| Digger | 0+1 |
| LinkBot | 1 |
| JCrawler | 0+1 |
| EchO! | 1 |