Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
GPTBotOAI-SearchBotBytespiderImagesiftBotFacebookBotanthropic-aiCCBotPerplexityBotChatGPT-UserClaude-WebClaudeBotGoogle-ExtendedOmgilibotApplebot-ExtendedDiffbotcohere-aiYouBot · 17
AI files
Evidence
robots:GPTBot+OAI-SearchBot+Bytespider+ImagesiftBot+FacebookBot+anthropic-ai+CCBot+PerplexityBot+ChatGPT-User+Claude-Web+ClaudeBot+Google-Extended+Omgilibot+Applebot-Extended+Diffbot+cohere-ai+YouBot
Compliance (GEO / GDPR)
TLD