Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderCCBotGPTBotPerplexityBotAmazonbotanthropic-aiFacebookBotGoogle-ExtendedMeta-ExternalAgentOmgilibotApplebot-ExtendedClaudeBot · 12
AI files
Evidence
robots:Bytespider+CCBot+GPTBot+PerplexityBot+Amazonbot+anthropic-ai+FacebookBot+Google-Extended+Meta-ExternalAgent+Omgilibot+Applebot-Extended+ClaudeBot
Compliance (GEO / GDPR)
TLD