Category
Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiClaudeBotGoogle-ExtendedYouBotCCBotBytespiderGPTBotChatGPT-UserMeta-ExternalAgentApplebot-ExtendedPerplexityBot · 11
AI files
Evidence
robots:anthropic-ai+ClaudeBot+Google-Extended+YouBot+CCBot+Bytespider+GPTBot+ChatGPT-User+Meta-ExternalAgent+Applebot-Extended+PerplexityBot
Compliance (GEO / GDPR)
TLD