Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiApplebot-ExtendedGPTBotOAI-SearchBotTimpibotYouBotCCBotClaude-WebBytespiderClaudeBotcohere-aiDiffbotGoogle-ExtendedMeta-ExternalAgentPerplexityBotAmazonbotChatGPT-UserFacebookBot · 18
AI files
Evidence
robots:anthropic-ai+Applebot-Extended+GPTBot+OAI-SearchBot+Timpibot+YouBot+CCBot+Claude-Web+Bytespider+ClaudeBot+cohere-ai+Diffbot+Google-Extended+Meta-ExternalAgent+PerplexityBot+Amazonbot+ChatGPT-User+FacebookBot