AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ImagesiftBotOAI-SearchBotanthropic-aiCCBotClaude-WebGPTBotOmgilibotYouBotApplebot-ExtendedClaudeBotcohere-aiMeta-ExternalAgentBytespiderDiffbotGoogle-ExtendedTimpibotAmazonbotChatGPT-UserFacebookBotPerplexityBot · 20
AI files
Evidence
robots:ImagesiftBot+OAI-SearchBot+anthropic-ai+CCBot+Claude-Web+GPTBot+Omgilibot+YouBot+Applebot-Extended+ClaudeBot+cohere-ai+Meta-ExternalAgent+Bytespider+Diffbot+Google-Extended+Timpibot+Amazonbot+ChatGPT-User+FacebookBot+PerplexityBot
Compliance (GEO / GDPR)
TLD