AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotBytespiderDiffbotFacebookBotTimpibotGoogle-ExtendedCCBotClaudeBotcohere-aiMeta-ExternalAgentanthropic-aiApplebot-ExtendedClaude-WebGPTBot · 14
AI files
Evidence
robots:Amazonbot+Bytespider+Diffbot+FacebookBot+Timpibot+Google-Extended+CCBot+ClaudeBot+cohere-ai+Meta-ExternalAgent+anthropic-ai+Applebot-Extended+Claude-Web+GPTBot
Compliance (GEO / GDPR)
TLD