User-agent: * Disallow: /awstats/ Disallow: /backend/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /email/ Disallow: /images/ Disallow: /js/ Disallow: /old_english/ Disallow: /swf/