Category
Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderGPTBotAmazonbotClaudeBotClaude-WebImagesiftBotMeta-ExternalAgentanthropic-aiCCBotcohere-aiPerplexityBotApplebot-ExtendedChatGPT-UserGoogle-ExtendedOmgilibotYouBot · 16
AI files
Evidence
robots:Bytespider+GPTBot+Amazonbot+ClaudeBot+Claude-Web+ImagesiftBot+Meta-ExternalAgent+anthropic-ai+CCBot+cohere-ai+PerplexityBot+Applebot-Extended+ChatGPT-User+Google-Extended+Omgilibot+YouBot
Compliance (GEO / GDPR)
TLD