Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiBytespiderCCBotGPTBotOmgilibotYouBotAmazonbotGoogle-Extendedcohere-aiChatGPT-UserClaude-WebClaudeBotPerplexityBotTimpibotApplebot-ExtendedFacebookBotImagesiftBotMeta-ExternalAgentOAI-SearchBotDiffbot · 20
AI files
Evidence
robots:anthropic-ai+Bytespider+CCBot+GPTBot+Omgilibot+YouBot+Amazonbot+Google-Extended+cohere-ai+ChatGPT-User+Claude-Web+ClaudeBot+PerplexityBot+Timpibot+Applebot-Extended+FacebookBot+ImagesiftBot+Meta-ExternalAgent+OAI-SearchBot+Diffbot
Compliance (GEO / GDPR)
TLD