# Robots.txt Sitemap: http://www.click71.com/sitemap.xml # Allow all robots to spider the domain User-agent: * Disallow: Disallow directory: /author/ Disallow: /2.asp Disallow: /3n.asp Disallow: /3a.asp Disallow: /3b.asp