Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentApplebot-ExtendedCCBotFacebookBotClaudeBotGoogle-ExtendedGPTBotOmgilibotPerplexityBotAmazonbotanthropic-aiBytespider · 12
AI files
Evidence
robots:Meta-ExternalAgent+Applebot-Extended+CCBot+FacebookBot+ClaudeBot+Google-Extended+GPTBot+Omgilibot+PerplexityBot+Amazonbot+anthropic-ai+Bytespider
Compliance (GEO / GDPR)
TLD