Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ClaudeBotClaude-WebBytespiderAmazonbotMeta-ExternalAgentGPTBotPerplexityBotCCBotanthropic-aiYouBot · 10
AI files
Evidence
robots:ClaudeBot+Claude-Web+Bytespider+Amazonbot+Meta-ExternalAgent+GPTBot+PerplexityBot+CCBot+anthropic-ai+YouBot
Compliance (GEO / GDPR)
TLD