Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentClaude-WebDiffbotFacebookBotAmazonbotanthropic-aiGoogle-ExtendedGPTBotCCBotcohere-aiClaudeBotTimpibotApplebot-ExtendedBytespider · 14
AI files
Evidence
robots:Meta-ExternalAgent+Claude-Web+Diffbot+FacebookBot+Amazonbot+anthropic-ai+Google-Extended+GPTBot+CCBot+cohere-ai+ClaudeBot+Timpibot+Applebot-Extended+Bytespider