Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
CCBotcohere-aiFacebookBotGPTBotTimpibotYouBotanthropic-aiOmgilibotPerplexityBotAmazonbotApplebot-ExtendedClaude-WebDiffbotImagesiftBotMeta-ExternalAgentBytespiderChatGPT-UserClaudeBotOAI-SearchBot · 19
AI files
Evidence
robots:CCBot+cohere-ai+FacebookBot+GPTBot+Timpibot+YouBot+anthropic-ai+Omgilibot+PerplexityBot+Amazonbot+Applebot-Extended+Claude-Web+Diffbot+ImagesiftBot+Meta-ExternalAgent+Bytespider+ChatGPT-User+ClaudeBot+OAI-SearchBot
Compliance (GEO / GDPR)
TLD