# # robots.txt for http://www.socialistproject.ca # example: http://www.w3.org/robots.txt # notes: http://www.robotstxt.org/wc/exclusion-admin.html # exclude some access-controlled areas User-agent: * Disallow: /cgi-bin/ Disallow: /lib/ Disallow: /lists/ Disallow: /shoppingcart/ Disallow: /upload/ Disallow: /_private/ Disallow: /marxon/ Disallow: /singer/ Disallow: /wur/