Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
PerplexityBotBytespiderCCBotMeta-ExternalAgentGPTBotChatGPT-Useranthropic-aiAmazonbotClaude-WebYouBot · 10
AI files
Evidence
robots:PerplexityBot+Bytespider+CCBot+Meta-ExternalAgent+GPTBot+ChatGPT-User+anthropic-ai+Amazonbot+Claude-Web+YouBot
Compliance (GEO / GDPR)
TLD