Category
Tech stack
Analytics
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
anthropic-aiChatGPT-UserDiffbotFacebookBotGoogle-ExtendedMeta-ExternalAgentTimpibotBytespidercohere-aiGPTBotOAI-SearchBotCCBotClaude-WebAmazonbotApplebot-ExtendedClaudeBotPerplexityBotYouBot · 18
AI files
Evidence
robots:anthropic-ai+ChatGPT-User+Diffbot+FacebookBot+Google-Extended+Meta-ExternalAgent+Timpibot+Bytespider+cohere-ai+GPTBot+OAI-SearchBot+CCBot+Claude-Web+Amazonbot+Applebot-Extended+ClaudeBot+PerplexityBot+YouBot
Compliance (GEO / GDPR)
TLD