## robots.txt ## http://support.google.com/webmasters/bin/answer.py?hl=en&answer=156449 ## Website Sitemap ## Sitemap: /sitemap.xml ## Crawlers Setup ## User-agent: * Crawl-delay: 10 ## Allowable ## Allow: /images/ ## Disllowable ## Disallow: /search/ Disallow: /blog/category/ Disallow: /blog/tag/