Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedCCBotTimpibotanthropic-aiDiffbotFacebookBotGoogle-Extendedcohere-aiClaude-WebGPTBotBytespiderClaudeBotMeta-ExternalAgentAmazonbot · 14
AI files
Evidence
robots:Applebot-Extended+CCBot+Timpibot+anthropic-ai+Diffbot+FacebookBot+Google-Extended+cohere-ai+Claude-Web+GPTBot+Bytespider+ClaudeBot+Meta-ExternalAgent+Amazonbot
Compliance (GEO / GDPR)
TLD