Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
GPTBotMeta-ExternalAgentBytespiderCCBotClaude-WebFacebookBotGoogle-Extendedanthropic-aiClaudeBotcohere-aiApplebot-ExtendedTimpibotAmazonbotDiffbot · 14
AI files
Evidence
robots:GPTBot+Meta-ExternalAgent+Bytespider+CCBot+Claude-Web+FacebookBot+Google-Extended+anthropic-ai+ClaudeBot+cohere-ai+Applebot-Extended+Timpibot+Amazonbot+Diffbot
Compliance (GEO / GDPR)
TLD