Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiApplebot-ExtendedBytespiderClaudeBotAmazonbotGoogle-ExtendedMeta-ExternalAgentTimpibotDiffbotcohere-aiClaude-WebFacebookBotGPTBotCCBot · 14
AI files
Evidence
robots:anthropic-ai+Applebot-Extended+Bytespider+ClaudeBot+Amazonbot+Google-Extended+Meta-ExternalAgent+Timpibot+Diffbot+cohere-ai+Claude-Web+FacebookBot+GPTBot+CCBot
Compliance (GEO / GDPR)
TLD