Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderDiffbotMeta-ExternalAgentApplebot-ExtendedFacebookBotGPTBotCCBotanthropic-aiClaude-WebGoogle-ExtendedAmazonbotcohere-aiTimpibotClaudeBot · 14
AI files
Evidence
robots:Bytespider+Diffbot+Meta-ExternalAgent+Applebot-Extended+FacebookBot+GPTBot+CCBot+anthropic-ai+Claude-Web+Google-Extended+Amazonbot+cohere-ai+Timpibot+ClaudeBot