Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedClaudeBotGoogle-ExtendedOAI-SearchBotTimpibotYouBotAmazonbotChatGPT-UserClaude-Webcohere-aiFacebookBotGPTBotBytespiderCCBotDiffbotPerplexityBotanthropic-aiMeta-ExternalAgent · 18
AI files
Evidence
robots:Applebot-Extended+ClaudeBot+Google-Extended+OAI-SearchBot+Timpibot+YouBot+Amazonbot+ChatGPT-User+Claude-Web+cohere-ai+FacebookBot+GPTBot+Bytespider+CCBot+Diffbot+PerplexityBot+anthropic-ai+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD