Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiChatGPT-UserClaudeBotGPTBotOmgilibotPerplexityBotMeta-ExternalAgentAmazonbotcohere-aiImagesiftBotYouBotCCBotBytespiderClaude-WebApplebot-ExtendedGoogle-Extended · 16
AI files
Evidence
robots:anthropic-ai+ChatGPT-User+ClaudeBot+GPTBot+Omgilibot+PerplexityBot+Meta-ExternalAgent+Amazonbot+cohere-ai+ImagesiftBot+YouBot+CCBot+Bytespider+Claude-Web+Applebot-Extended+Google-Extended
Compliance (GEO / GDPR)
TLD