Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ChatGPT-UserDiffbotGoogle-ExtendedMeta-ExternalAgentYouBotanthropic-aiClaude-WebFacebookBotOAI-SearchBotTimpibotGPTBotPerplexityBotcohere-aiAmazonbotApplebot-ExtendedBytespiderCCBotClaudeBot · 18
AI files
Evidence
robots:ChatGPT-User+Diffbot+Google-Extended+Meta-ExternalAgent+YouBot+anthropic-ai+Claude-Web+FacebookBot+OAI-SearchBot+Timpibot+GPTBot+PerplexityBot+cohere-ai+Amazonbot+Applebot-Extended+Bytespider+CCBot+ClaudeBot
Compliance (GEO / GDPR)
TLD