Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
GPTBotTimpibotBytespiderCCBotDiffbotGoogle-ExtendedApplebot-ExtendedClaude-WebAmazonbotanthropic-aicohere-aiClaudeBotFacebookBotMeta-ExternalAgent · 14
AI files
Evidence
robots:GPTBot+Timpibot+Bytespider+CCBot+Diffbot+Google-Extended+Applebot-Extended+Claude-Web+Amazonbot+anthropic-ai+cohere-ai+ClaudeBot+FacebookBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD