Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderClaudeBotFacebookBotGPTBotPerplexityBotApplebot-Extendedanthropic-aiCCBotGoogle-ExtendedMeta-ExternalAgentOmgilibotAmazonbot · 12
AI files
Evidence
robots:Bytespider+ClaudeBot+FacebookBot+GPTBot+PerplexityBot+Applebot-Extended+anthropic-ai+CCBot+Google-Extended+Meta-ExternalAgent+Omgilibot+Amazonbot
Compliance (GEO / GDPR)
TLD