# Hello Mr Robot. Nice to meet you. User-agent: Googlebot Disallow: /internal/ # Google requires disallow for preventing crawling, and then separately # Noindex for preventing being stored in the index Noindex: /internal/ User-agent: * Disallow: /internal/