Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiClaude-WebClaudeBotTimpibotcohere-aiGoogle-ExtendedApplebot-ExtendedCCBotDiffbotFacebookBotAmazonbotBytespiderGPTBotMeta-ExternalAgent · 14
AI files
Evidence
robots:anthropic-ai+Claude-Web+ClaudeBot+Timpibot+cohere-ai+Google-Extended+Applebot-Extended+CCBot+Diffbot+FacebookBot+Amazonbot+Bytespider+GPTBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD