Category
Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
OmgilibotPerplexityBotMeta-ExternalAgentAmazonbotApplebot-ExtendedBytespiderClaude-WebGPTBotChatGPT-UserClaudeBotImagesiftBotanthropic-aiCCBotcohere-aiGoogle-ExtendedYouBot · 16
AI files
Evidence
robots:Omgilibot+PerplexityBot+Meta-ExternalAgent+Amazonbot+Applebot-Extended+Bytespider+Claude-Web+GPTBot+ChatGPT-User+ClaudeBot+ImagesiftBot+anthropic-ai+CCBot+cohere-ai+Google-Extended+YouBot
Compliance (GEO / GDPR)
TLD