User-agent:* Disallow:/cgi-bin/ Disallow:/logs/ Disallow:/private/ Disallow:/forms/ Disallow:/error/ Disallow:/admin/ Disallow:/dot/ User-Agent: W3C-checklink Disallow: