# robots.txt # Robot-exclusion file User-agent: * # ROOT DIRECTORY EXCLUSIONS FOLLOW # Disallow: / Disallow: /NewSite/ Disallow: /Old_Site/