Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
CCBotChatGPT-UserGPTBotImagesiftBotPerplexityBotAmazonbotcohere-aiBytespiderOmgilibotanthropic-aiApplebot-ExtendedClaudeBotClaude-WebGoogle-ExtendedYouBotMeta-ExternalAgent · 16
AI files
Evidence
robots:CCBot+ChatGPT-User+GPTBot+ImagesiftBot+PerplexityBot+Amazonbot+cohere-ai+Bytespider+Omgilibot+anthropic-ai+Applebot-Extended+ClaudeBot+Claude-Web+Google-Extended+YouBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD