Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Google-Extendedcohere-aiOmgilibotImagesiftBotCCBotPerplexityBotApplebot-Extendedanthropic-aiBytespiderChatGPT-UserClaudeBotGPTBotAmazonbotFacebookBotMeta-ExternalAgentClaude-WebYouBotDiffbot · 18
AI files
Evidence
robots:Google-Extended+cohere-ai+Omgilibot+ImagesiftBot+CCBot+PerplexityBot+Applebot-Extended+anthropic-ai+Bytespider+ChatGPT-User+ClaudeBot+GPTBot+Amazonbot+FacebookBot+Meta-ExternalAgent+Claude-Web+YouBot+Diffbot
Compliance (GEO / GDPR)
TLD