Category
Tech stack
CDN
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
Google-ExtendedGPTBotanthropic-aiBytespiderClaude-WebAmazonbotApplebot-ExtendedImagesiftBotcohere-aiOmgilibotCCBotChatGPT-UserClaudeBotPerplexityBotYouBotMeta-ExternalAgent · 16
AI files
Evidence
robots:Google-Extended+GPTBot+anthropic-ai+Bytespider+Claude-Web+Amazonbot+Applebot-Extended+ImagesiftBot+cohere-ai+Omgilibot+CCBot+ChatGPT-User+ClaudeBot+PerplexityBot+YouBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD