# robots.txt for www.clubweb.org and co-hosted domains # This file restricts webCrawlers (e.g. Google, Altavista...) from certain parts of the site # The first line is a required header for some sites. # Text following a hash on any line represents a comment # "Block" search engines from areas we want them to avoid User-agent: * # All Crawlers Disallow: /private/ Disallow: /dbase/ Disallow: /pages/ Disallow: /temp/ Disallow: /aspnet_client/ Disallow: /infra/docs/