Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
DiffbotFacebookBotanthropic-aiBytespidercohere-aiMeta-ExternalAgentGoogle-ExtendedAmazonbotCCBotClaude-WebClaudeBotApplebot-ExtendedGPTBotTimpibot · 14
AI files
Evidence
robots:Diffbot+FacebookBot+anthropic-ai+Bytespider+cohere-ai+Meta-ExternalAgent+Google-Extended+Amazonbot+CCBot+Claude-Web+ClaudeBot+Applebot-Extended+GPTBot+Timpibot