Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentOmgilibotAmazonbotApplebot-ExtendedBytespiderCCBotClaudeBotGoogle-Extendedanthropic-aiFacebookBotGPTBotPerplexityBot · 12
AI files
Evidence
robots:Meta-ExternalAgent+Omgilibot+Amazonbot+Applebot-Extended+Bytespider+CCBot+ClaudeBot+Google-Extended+anthropic-ai+FacebookBot+GPTBot+PerplexityBotllms.txt
Compliance (GEO / GDPR)
TLD