Category
Tech stack
CDN
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
CCBotClaudeBotClaude-WebGoogle-ExtendedImagesiftBotBytespidercohere-aiOmgilibotPerplexityBotMeta-ExternalAgentYouBotAmazonbotanthropic-aiApplebot-ExtendedChatGPT-UserGPTBot · 16
AI files
Evidence
robots:CCBot+ClaudeBot+Claude-Web+Google-Extended+ImagesiftBot+Bytespider+cohere-ai+Omgilibot+PerplexityBot+Meta-ExternalAgent+YouBot+Amazonbot+anthropic-ai+Applebot-Extended+ChatGPT-User+GPTBot
Compliance (GEO / GDPR)
TLD