User-agent: * Disallow: /bottrap/ User-agent: * Disallow: /bot-trap/ User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: WeirdBot Disallow: / User-agent: LinkWalker Disallow: / User-agent: EmailSiphon Disallow: / User-agent: WOMP::URL.pm/1.000 Disallow: / User-agent: ia_archiver Disallow: / User-agent: Lickity_Split/2.5+ Disallow: / User-agent: Lickity_Split_Spider+ Disallow: / User-agent: Lickity_Split+ Disallow: / User-agent: Mozilla Disallow: / User-agent: Scooter_x0-3.2.EX Disallow: / User-agent: Openbot/3.0+ Disallow: / User-agent: PSurf15a VA Disallow: / User-agent: bumblebee/1.0 Disallow: / User-agent: Scooter-3.2.NIV Disallow: / User-agent: Lycos_Spider_(modspider) Disallow: / User-agent: Scooter Disallow: / User-agent: FAST-WebCrawler/3.6/FirstPage Disallow: / User-agent: ZyBorg/1.0 Disallow: / User-agent: Lachesis Disallow: / User-agent: FlickBot Disallow: / User-agent: VoilaBot; 1.6 Disallow: / User-agent: FAST-WebCrawler/3.6 Disallow: / User-agent: _VoilaBot/1.6 libwww/5.3.2 Disallow: / User-agent: Slurp/cat Disallow: / User-agent: Slurp/cat; slurp@inktomi.com Disallow: / User-agent: slurp@inktomi.com Disallow: / User-agent: Scrubby/2.2 Disallow: / User-agent: Scrubby/2.2(http://www.scrubtheweb.com/) Disallow: / User-agent: polybot Disallow: / User-agent: rico/0.1 Disallow: / User-agent: TurnitinBot/1.5 Disallow: / User-agent: SPYder (beta)/3.1.6 (http://healthorgs.com) Disallow: / User-agent: SPYder (beta)/3.1.6 Disallow: /