Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Claude-WebDiffbotFacebookBotMeta-ExternalAgentOmgilibotBytespiderChatGPT-UserClaudeBotPerplexityBotcohere-aiYouBotCCBotGPTBotImagesiftBotTimpibotAmazonbotanthropic-aiApplebot-ExtendedOAI-SearchBot · 19
AI files
Evidence
robots:Claude-Web+Diffbot+FacebookBot+Meta-ExternalAgent+Omgilibot+Bytespider+ChatGPT-User+ClaudeBot+PerplexityBot+cohere-ai+YouBot+CCBot+GPTBot+ImagesiftBot+Timpibot+Amazonbot+anthropic-ai+Applebot-Extended+OAI-SearchBot
Compliance (GEO / GDPR)
TLD