Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Amazonbotanthropic-aiFacebookBotGoogle-ExtendedGPTBotTimpibotClaude-WebApplebot-ExtendedBytespiderClaudeBotMeta-ExternalAgentCCBotcohere-aiDiffbot · 14
AI files
Evidence
robots:Amazonbot+anthropic-ai+FacebookBot+Google-Extended+GPTBot+Timpibot+Claude-Web+Applebot-Extended+Bytespider+ClaudeBot+Meta-ExternalAgent+CCBot+cohere-ai+Diffbot
Compliance (GEO / GDPR)
TLD