User-agent: * Disallow: /admin Disallow: /backup Disallow: /cgi-bin Disallow: /images Disallow: /include Disallow: /javascripts Disallow: /lang Disallow: /libs Disallow: /temp Disallow: /templates User-agent: Mediapartners-Google* Disallow: ia_archiver Disallow: almaden.ibm.com disallow: appie 1.1 disallow: architext disallow: ask jeeves disallow: asterias2.0 disallow: augurfind disallow: baiduspider disallow: bannana_bot disallow: bdcindexer disallow: crawler disallow: crawler@fast disallow: docomo disallow: fast-webcrawler disallow: FAST-WebCrawler disallow: fluffy the spider disallow: frooglebot disallow: geobot disallow: googlebot disallow: /images/ gulliver disallow: henrythemiragorobot disallow: ia_archiver disallow: infoseek disallow: kit_fireball disallow: lachesis disallow: lycos_spider disallow: mantraagent disallow: mercator disallow: moget/1.0 disallow: muscatferret disallow: nationaldirectory-webspider disallow: naverrobot disallow: ncsa beta disallow: netresearchserver disallow: ng/1.0 disallow: osis-project disallow: polybot disallow: pompos disallow: scooter disallow: seventwentyfour disallow: sidewinder disallow: sleek spider disallow: slurp/si disallow: slurp@inktomi.com disallow: steeler/1.3 disallow: szukacz disallow: t-h-u-n-d-e-r-s-t-o-n-e disallow: teoma disallow: turnitinbot disallow: ultraseek disallow: vagabondo disallow: voilabot disallow: w3c_validator disallow: zao/0 disallow: zyborg/1.0 disallow: User-agent: FreeFind disallow: /admin/ User-agent: looksmart Disallow: User-agent: Lycos_Spider_modspider Disallow: User-agent: Jeeves Disallow: User-agent: AskJeeves Disallow: User-agent: Ask Jeeves Disallow: User-agent: MSNBot Disallow: User-agent: VoilaBot Disallow: User-agent: Exactseek-crawler Disallow: User-agent: Slurp Disallow: User-agent: WISENutbot Disallow: