User-agent: * Crawl-delay: 10 Disallow: /admin/ Disallow: /comments/ Disallow: /cr/