AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedCCBotClaudeBotDiffbotFacebookBotPerplexityBotanthropic-aiClaude-WebBytespiderChatGPT-UserMeta-ExternalAgentOAI-SearchBotTimpibotAmazonbotcohere-aiGoogle-ExtendedGPTBotYouBot · 18
AI files
Evidence
robots:Applebot-Extended+CCBot+ClaudeBot+Diffbot+FacebookBot+PerplexityBot+anthropic-ai+Claude-Web+Bytespider+ChatGPT-User+Meta-ExternalAgent+OAI-SearchBot+Timpibot+Amazonbot+cohere-ai+Google-Extended+GPTBot+YouBot
Compliance (GEO / GDPR)
TLD