Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentPerplexityBotApplebot-ExtendedCCBotFacebookBotBytespiderClaude-WebGPTBotYouBotClaudeBotcohere-aiDiffbotGoogle-ExtendedOAI-SearchBotAmazonbotanthropic-aiChatGPT-UserTimpibot · 18
AI files
Evidence
robots:Meta-ExternalAgent+PerplexityBot+Applebot-Extended+CCBot+FacebookBot+Bytespider+Claude-Web+GPTBot+YouBot+ClaudeBot+cohere-ai+Diffbot+Google-Extended+OAI-SearchBot+Amazonbot+anthropic-ai+ChatGPT-User+Timpibot
Compliance (GEO / GDPR)
TLD