# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: / User-Agent: * Disallow: /create Disallow: /step Disallow: /finish Disallow: /jump_to Disallow: /zip_s Disallow: /lead_s2 Disallow: /index3 Disallow: /assets