Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ChatGPT-Useranthropic-aiMeta-ExternalAgentBytespiderTimpibotGoogle-ExtendedClaude-WebAmazonbotYouBotOAI-SearchBotPerplexityBotGPTBotCCBotDiffbotOmgilibotcohere-ai · 16
AI files
Evidence
robots:ChatGPT-User+anthropic-ai+Meta-ExternalAgent+Bytespider+Timpibot+Google-Extended+Claude-Web+Amazonbot+YouBot+OAI-SearchBot+PerplexityBot+GPTBot+CCBot+Diffbot+Omgilibot+cohere-aillms.txt
Compliance (GEO / GDPR)
TLD