Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderCCBotClaude-Webcohere-aiDiffbotFacebookBotMeta-ExternalAgentanthropic-aiApplebot-ExtendedGPTBotAmazonbotGoogle-ExtendedTimpibotClaudeBot · 14
AI files
Evidence
robots:Bytespider+CCBot+Claude-Web+cohere-ai+Diffbot+FacebookBot+Meta-ExternalAgent+anthropic-ai+Applebot-Extended+GPTBot+Amazonbot+Google-Extended+Timpibot+ClaudeBot
Compliance (GEO / GDPR)
TLD