# robots.txt file # according to the Robot Exclusion Standard # at http://www.robotstxt.org/wc/norobots.html User-agent: * Disallow: /cgi-bin/ Disallow: /private/ Sitemap: http://www.ls.cs.cmu.edu/sitemap.xml.gz