Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
CCBotChatGPT-UserClaudeBotBytespiderImagesiftBotYouBotMeta-ExternalAgentAmazonbotanthropic-aiClaude-Webcohere-aiGoogle-ExtendedApplebot-ExtendedGPTBotOmgilibotPerplexityBot · 16
AI files
Evidence
robots:CCBot+ChatGPT-User+ClaudeBot+Bytespider+ImagesiftBot+YouBot+Meta-ExternalAgent+Amazonbot+anthropic-ai+Claude-Web+cohere-ai+Google-Extended+Applebot-Extended+GPTBot+Omgilibot+PerplexityBot
Compliance (GEO / GDPR)
TLD