Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ClaudeBotBytespiderClaude-WebDiffbotMeta-ExternalAgentTimpibotApplebot-ExtendedFacebookBotGoogle-ExtendedAmazonbotanthropic-aiCCBotcohere-aiGPTBot · 14
AI files
Evidence
robots:ClaudeBot+Bytespider+Claude-Web+Diffbot+Meta-ExternalAgent+Timpibot+Applebot-Extended+FacebookBot+Google-Extended+Amazonbot+anthropic-ai+CCBot+cohere-ai+GPTBot