Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
GPTBotOAI-SearchBotApplebot-ExtendedFacebookBotOmgilibotPerplexityBotYouBotCCBotMeta-ExternalAgentcohere-aiImagesiftBotTimpibotAmazonbotClaude-WebChatGPT-UserClaudeBotDiffbotanthropic-aiBytespider · 19
AI files
Evidence
robots:GPTBot+OAI-SearchBot+Applebot-Extended+FacebookBot+Omgilibot+PerplexityBot+YouBot+CCBot+Meta-ExternalAgent+cohere-ai+ImagesiftBot+Timpibot+Amazonbot+Claude-Web+ChatGPT-User+ClaudeBot+Diffbot+anthropic-ai+Bytespider
Compliance (GEO / GDPR)
TLD