Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
CCBotDiffbotClaudeBotGPTBotAmazonbotanthropic-aiApplebot-Extendedcohere-aiTimpibotBytespiderClaude-WebFacebookBotGoogle-ExtendedMeta-ExternalAgent · 14
AI files
Evidence
robots:CCBot+Diffbot+ClaudeBot+GPTBot+Amazonbot+anthropic-ai+Applebot-Extended+cohere-ai+Timpibot+Bytespider+Claude-Web+FacebookBot+Google-Extended+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD