Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ChatGPT-UserGoogle-ExtendedGPTBotClaude-WebDiffbotFacebookBotMeta-ExternalAgentanthropic-aiApplebot-ExtendedBytespiderCCBotYouBotAmazonbotcohere-aiOAI-SearchBotTimpibotClaudeBotPerplexityBot · 18
AI files
Evidence
robots:ChatGPT-User+Google-Extended+GPTBot+Claude-Web+Diffbot+FacebookBot+Meta-ExternalAgent+anthropic-ai+Applebot-Extended+Bytespider+CCBot+YouBot+Amazonbot+cohere-ai+OAI-SearchBot+Timpibot+ClaudeBot+PerplexityBot
Compliance (GEO / GDPR)
TLD