Category
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
Meta-ExternalAgentTimpibotAmazonbotanthropic-aiApplebot-ExtendedDiffbotGoogle-ExtendedBytespiderCCBotYouBotClaude-Webcohere-aiPerplexityBotChatGPT-UserClaudeBotFacebookBotGPTBotOAI-SearchBot · 18
AI files
Evidence
robots:Meta-ExternalAgent+Timpibot+Amazonbot+anthropic-ai+Applebot-Extended+Diffbot+Google-Extended+Bytespider+CCBot+YouBot+Claude-Web+cohere-ai+PerplexityBot+ChatGPT-User+ClaudeBot+FacebookBot+GPTBot+OAI-SearchBotx-robots:noai
Compliance (GEO / GDPR)
TLD