Category
Tech stack
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
anthropic-aiApplebot-ExtendedBytespiderClaudeBotGoogle-ExtendedMeta-ExternalAgentOmgilibotAmazonbotFacebookBotGPTBotPerplexityBotCCBot · 12
AI files
Evidence
robots:anthropic-ai+Applebot-Extended+Bytespider+ClaudeBot+Google-Extended+Meta-ExternalAgent+Omgilibot+Amazonbot+FacebookBot+GPTBot+PerplexityBot+CCBotpage:no-ai-training
Compliance (GEO / GDPR)
TLD