Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotApplebot-ExtendedCCBotClaudeBotOAI-SearchBotanthropic-aiDiffbotGPTBotTimpibotYouBotChatGPT-Usercohere-aiMeta-ExternalAgentPerplexityBotBytespiderClaude-WebFacebookBotGoogle-Extended · 18
AI files
Evidence
robots:Amazonbot+Applebot-Extended+CCBot+ClaudeBot+OAI-SearchBot+anthropic-ai+Diffbot+GPTBot+Timpibot+YouBot+ChatGPT-User+cohere-ai+Meta-ExternalAgent+PerplexityBot+Bytespider+Claude-Web+FacebookBot+Google-Extended
Compliance (GEO / GDPR)
TLD