Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
YouBotGPTBotImagesiftBotAmazonbotcohere-aiBytespiderCCBotChatGPT-UserClaude-WebGoogle-ExtendedOmgilibotanthropic-aiApplebot-ExtendedPerplexityBotMeta-ExternalAgentClaudeBot · 16
AI files
Evidence
robots:YouBot+GPTBot+ImagesiftBot+Amazonbot+cohere-ai+Bytespider+CCBot+ChatGPT-User+Claude-Web+Google-Extended+Omgilibot+anthropic-ai+Applebot-Extended+PerplexityBot+Meta-ExternalAgent+ClaudeBot
Compliance (GEO / GDPR)
TLD