# For more info about robots.txt visit # http://www.robotstxt.org/wc/robots.html # Applies rule to agents - * applies to all agents User-agent: * #### General Blocks #### Disallow: /content Disallow: /css Disallow: /includes Disallow: /images Disallow: /js Disallow: /template Disallow: test.txt