Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotCCBotFacebookBotGPTBotanthropic-aiApplebot-ExtendedBytespiderClaudeBotGoogle-ExtendedMeta-ExternalAgentOmgilibotPerplexityBot · 12
AI files
Evidence
robots:Amazonbot+CCBot+FacebookBot+GPTBot+anthropic-ai+Applebot-Extended+Bytespider+ClaudeBot+Google-Extended+Meta-ExternalAgent+Omgilibot+PerplexityBot
Compliance (GEO / GDPR)
TLD