Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
ClaudeBotClaude-WebGPTBotMeta-ExternalAgentanthropic-aiApplebot-ExtendedBytespiderCCBotcohere-aiGoogle-ExtendedOmgilibotPerplexityBotYouBotAmazonbotChatGPT-UserImagesiftBot · 16
AI files
Evidence
robots:ClaudeBot+Claude-Web+GPTBot+Meta-ExternalAgent+anthropic-ai+Applebot-Extended+Bytespider+CCBot+cohere-ai+Google-Extended+Omgilibot+PerplexityBot+YouBot+Amazonbot+ChatGPT-User+ImagesiftBot
Compliance (GEO / GDPR)
TLD