Category
Tech stack
CMS
E-commerce
Analytics
CDN
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Google-ExtendedClaudeBotClaude-WebFacebookBotYouBotOmgilibotGPTBotChatGPT-UserCCBotcohere-aiAmazonbotMeta-ExternalAgentBytespiderPerplexityBotApplebot-ExtendedDiffbotTimpibotOAI-SearchBotanthropic-ai · 19
AI files
Evidence
robots:Google-Extended+ClaudeBot+Claude-Web+FacebookBot+YouBot+Omgilibot+GPTBot+ChatGPT-User+CCBot+cohere-ai+Amazonbot+Meta-ExternalAgent+Bytespider+PerplexityBot+Applebot-Extended+Diffbot+Timpibot+OAI-SearchBot+anthropic-aillms.txt
Compliance (GEO / GDPR)
TLD