Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiClaudeBotAmazonbotApplebot-ExtendedCCBotClaude-Webcohere-aiOAI-SearchBotYouBotDiffbotFacebookBotMeta-ExternalAgentPerplexityBotTimpibotBytespiderChatGPT-UserGPTBotImagesiftBotOmgilibot · 19
AI files
Evidence
robots:anthropic-ai+ClaudeBot+Amazonbot+Applebot-Extended+CCBot+Claude-Web+cohere-ai+OAI-SearchBot+YouBot+Diffbot+FacebookBot+Meta-ExternalAgent+PerplexityBot+Timpibot+Bytespider+ChatGPT-User+GPTBot+ImagesiftBot+Omgilibot
Compliance (GEO / GDPR)
TLD