Category
Tech stack
CDN
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
Meta-ExternalAgentAmazonbotanthropic-aiCCBotcohere-aiGoogle-ExtendedChatGPT-UserClaudeBotPerplexityBotOmgilibotYouBotApplebot-ExtendedBytespiderClaude-WebGPTBotImagesiftBot · 16
AI files
Evidence
robots:Meta-ExternalAgent+Amazonbot+anthropic-ai+CCBot+cohere-ai+Google-Extended+ChatGPT-User+ClaudeBot+PerplexityBot+Omgilibot+YouBot+Applebot-Extended+Bytespider+Claude-Web+GPTBot+ImagesiftBot
Compliance (GEO / GDPR)
TLD