Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
GPTBotYouBotClaude-WebOAI-SearchBotGoogle-ExtendedApplebot-ExtendedCCBotTimpibotChatGPT-UserPerplexityBotMeta-ExternalAgentAmazonbotClaudeBotcohere-aiBytespiderImagesiftBotDiffbotOmgilibotFacebookBotanthropic-ai · 20
AI files
Evidence
robots:GPTBot+YouBot+Claude-Web+OAI-SearchBot+Google-Extended+Applebot-Extended+CCBot+Timpibot+ChatGPT-User+PerplexityBot+Meta-ExternalAgent+Amazonbot+ClaudeBot+cohere-ai+Bytespider+ImagesiftBot+Diffbot+Omgilibot+FacebookBot+anthropic-ai