Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
FacebookBotMeta-ExternalAgentanthropic-aiBytespiderClaudeBotGoogle-ExtendedGPTBotOmgilibotPerplexityBotAmazonbotApplebot-ExtendedCCBot · 12
AI files
Evidence
robots:FacebookBot+Meta-ExternalAgent+anthropic-ai+Bytespider+ClaudeBot+Google-Extended+GPTBot+Omgilibot+PerplexityBot+Amazonbot+Applebot-Extended+CCBot
Compliance (GEO / GDPR)
TLD