User-agent: Mediapartners-Google* Disallow: User-agent: Slurp Crawl-delay: 120 User-agent: YahooSeeker Crawl-delay: 120 User-agent: MSNBot Crawl-delay: 120 User-agent: * Disallow: /includes/ Disallow: /admin/ Disallow: /profile.php?user= Disallow: /app.php Disallow: /album.php Disallow: /album.php?user= Disallow: /home.php Disallow: /blog.php Disallow: /video.php Disallow: /groups.php User-Agent: BecomeBot Disallow: / User-Agent: Twiceler Disallow: / User-Agent: Exabot Disallow: / User-Agent: Charlotte Disallow: / User-Agent: Speedy Spider Disallow: / User-Agent: BaiDuSpider Disallow: / User-Agent: Cherry Picker Disallow: / User-Agent: Crescent Internet ToolPak Disallow: / User-Agent: DISCo Pump Disallow: / User-Agent: EmailSiphon Disallow: / User-Agent: htdig Disallow: / User-Agent: HTTrack Disallow: / User-Agent: LNSpiderGuy Disallow: / User-Agent: Netprospector Disallow: / User-Agent: PerMan Surfer Disallow: / User-Agent: psbot Disallow: / User-Agent: szukacz Disallow: / User-Agent: RPT-HTTPClient Disallow: / User-Agent: Teleport Disallow: / User-Agent: Telesoft Disallow: / User-Agent: Ultraseek Disallow: / User-Agent: vspider Disallow: / User-Agent: WebCopier Disallow: / User-Agent: WebEMailExtractor Disallow: / User-Agent: WebReaper Disallow: / User-Agent: Webster Pro Disallow: / User-Agent: WebStripper Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: wget Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / User-agent: WebReaper Disallow: /