Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotDiffbotFacebookBotGoogle-ExtendedMeta-ExternalAgentBytespiderCCBotanthropic-aicohere-aiClaudeBotGPTBotTimpibotApplebot-ExtendedClaude-Web · 14
AI files
Evidence
robots:Amazonbot+Diffbot+FacebookBot+Google-Extended+Meta-ExternalAgent+Bytespider+CCBot+anthropic-ai+cohere-ai+ClaudeBot+GPTBot+Timpibot+Applebot-Extended+Claude-Web