Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
anthropic-aiApplebot-ExtendedBytespiderYouBotPerplexityBotMeta-ExternalAgentCCBotClaude-Webcohere-aiGPTBotAmazonbotGoogle-ExtendedImagesiftBotChatGPT-UserClaudeBotOmgilibot · 16
AI files
Evidence
robots:anthropic-ai+Applebot-Extended+Bytespider+YouBot+PerplexityBot+Meta-ExternalAgent+CCBot+Claude-Web+cohere-ai+GPTBot+Amazonbot+Google-Extended+ImagesiftBot+ChatGPT-User+ClaudeBot+Omgilibot
Compliance (GEO / GDPR)
TLD