User-agent: Mediapartners-Google* Crawl-delay: 60 Disallow: User-agent: Googlebot Crawl-delay: 60 Disallow: User-agent: Slurp Crawl-delay: 60 Disallow: User-agent: msnbot Crawl-delay: 60 Disallow: User-Agent: W3C-checklink Disallow: User-agent: InternetSeer.com Disallow: / User-agent: Microsoft Disallow: / User-agent: Control Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 98) Disallow: / User-agent: Mozilla/4.0+(compatible; MSIE 4.0; Windows 98) Disallow: / User-agent: MFC Foundation Class Library Disallow: / User-agent: BaiDuSpider* Disallow: / User-agent: Charlotte Disallow: / User-agent: Cherry Picker Disallow: / User-agent: Crescent Internet ToolPak Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: DISCo Pump Disallow: / User-agent: EmailSiphon Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: BecomeBot Disallow: / User-agent: findlinks Disallow: / User-agent: Exabot* Disallow: / User-agent: Gaisbot Disallow: / User-agent: GenieBot Disallow: / User-agent: gigabot* Disallow: / User-agent: grub Disallow: / User-agent: happyfunbot Disallow: / User-agent: htdig Disallow: / User-agent: HTTrack Disallow: / User-agent: ichiro Disallow: / User-agent: IconSurf Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: IRLbot Disallow: / User-agent: ipselonbot Disallow: / User-agent: LocalcomBot Disallow: / User-agent: LNSpiderGuy Disallow: / User-agent: MJ12bot Disallow: / User-agent: Netprospector Disallow: / User-agent: NewsTroveBot Disallow: / User-agent: Nutch Disallow: / User-agent: Ocelli Disallow: / User-agent: PerMan Surfer Disallow: / User-agent: psbot Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: Speedy Disallow: / User-agent: szukacz Disallow: / User-agent: RPT-HTTPClient Disallow: / User-agent: Teleport Disallow: / User-agent: Telesoft Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: Ultraseek Disallow: / User-agent: vspider Disallow: / User-agent: WebCopier Disallow: / User-agent: WebEMailExtractor Disallow: / User-agent: WebReaper Disallow: / User-agent: Webster Pro Disallow: / User-agent: WebStripper Disallow: /