| 40 different robots | Hits |
| Unknown robot (identified by 'crawl') | 475871+3870 |
| Inktomi Slurp | 281528+4859 |
| Voyager | 97521+5 |
| Voila | 37643+981 |
| Unknown robot (identified by 'robot') | 27049+2365 |
| Unknown robot (identified by hit on 'robots.txt') | 0+10471 |
| Yandex bot | 7712+775 |
| LinkScan | 7864 |
| Googlebot | 6807+24 |
| arks | 5323 |
| MSIECrawler | 3879+90 |
| Turn It In | 2905+19 |
| Tarantula | 1014 |
| Unknown robot (identified by 'spider') | 466+201 |
| Alexa (IA Archiver) | 0+345 |
| larbin | 168+130 |
| SurveyBot | 246+35 |
| The Python Robot | 202+10 |
| Motor | 141 |
| StackRambler | 91+48 |
| Web Core / Roots | 104+1 |
| BBot | 83+6 |
| Grub.org | 65 |
| Scooter | 55 |
| LinkChecker | 24 |
| Holmes | 4+17 |
| Fish search | 18+2 |
| EchO! | 17 |
| mnoGoSearch search engine software | 10+4 |
| Netcraft | 11 |
| gammaSpider, FocusedCrawler | 9 |
| Digger | 2+5 |
| MSNBot | 6 |
| WISENutbot | 5 |
| UCSD Crawl | 5 |
| DNAbot | 2+2 |
| AskJeeves | 4 |
| Robozilla | 2 |
| JBot Java Web Robot | 1 |
| Pita (webmaster@pita.stanford.edu) | 1 |