# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Disallow: /groups/ Disallow: /lessons/ Disallow: /users/ Disallow: /users/* Disallow: /schools Disallow: /orders Disallow: /emails Disallow: /countries Disallow: /regions # Disallow: /