# Exclusions for web crawlers User-agent: * Disallow: /internal/secure