Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Google-ExtendedBytespiderCCBotcohere-aiFacebookBotAmazonbotApplebot-ExtendedDiffbotClaude-WebClaudeBotMeta-ExternalAgentanthropic-aiGPTBotTimpibot · 14
AI files
Evidence
robots:Google-Extended+Bytespider+CCBot+cohere-ai+FacebookBot+Amazonbot+Applebot-Extended+Diffbot+Claude-Web+ClaudeBot+Meta-ExternalAgent+anthropic-ai+GPTBot+Timpibot
Compliance (GEO / GDPR)
TLD