Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiTimpibotCCBotChatGPT-UserAmazonbotBytespiderFacebookBotGoogle-ExtendedImagesiftBotMeta-ExternalAgentClaudeBotPerplexityBotClaude-WebOAI-SearchBotApplebot-Extendedcohere-aiDiffbotGPTBotOmgilibotYouBot · 20
AI files
Evidence
robots:anthropic-ai+Timpibot+CCBot+ChatGPT-User+Amazonbot+Bytespider+FacebookBot+Google-Extended+ImagesiftBot+Meta-ExternalAgent+ClaudeBot+PerplexityBot+Claude-Web+OAI-SearchBot+Applebot-Extended+cohere-ai+Diffbot+GPTBot+Omgilibot+YouBot