AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
OAI-SearchBotFacebookBotGPTBotClaudeBotcohere-aiApplebot-ExtendedOmgilibotanthropic-aiCCBotChatGPT-UserPerplexityBotAmazonbotYouBotTimpibotClaude-WebGoogle-ExtendedBytespiderDiffbotImagesiftBotMeta-ExternalAgent · 20
AI files
Evidence
robots:OAI-SearchBot+FacebookBot+GPTBot+ClaudeBot+cohere-ai+Applebot-Extended+Omgilibot+anthropic-ai+CCBot+ChatGPT-User+PerplexityBot+Amazonbot+YouBot+Timpibot+Claude-Web+Google-Extended+Bytespider+Diffbot+ImagesiftBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD