Category
Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Bytespideranthropic-aiPerplexityBotMeta-ExternalAgentYouBotCCBotApplebot-ExtendedGPTBotChatGPT-UserClaudeBotGoogle-Extended · 11
AI files
Evidence
robots:Bytespider+anthropic-ai+PerplexityBot+Meta-ExternalAgent+YouBot+CCBot+Applebot-Extended+GPTBot+ChatGPT-User+ClaudeBot+Google-Extended
Compliance (GEO / GDPR)
TLD