Category
Tech stack
CMS
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentanthropic-aiGoogle-ExtendedBytespiderCCBotClaudeBotFacebookBotGPTBotOmgilibotAmazonbotApplebot-ExtendedPerplexityBot · 12
AI files
Evidence
robots:Meta-ExternalAgent+anthropic-ai+Google-Extended+Bytespider+CCBot+ClaudeBot+FacebookBot+GPTBot+Omgilibot+Amazonbot+Applebot-Extended+PerplexityBot
Compliance (GEO / GDPR)
TLD