Category
Tech stack
Framework
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
Claude-WebFacebookBotGoogle-ExtendedAmazonbotApplebot-ExtendedCCBotcohere-aiGPTBotanthropic-aiBytespiderClaudeBotTimpibotDiffbotMeta-ExternalAgent · 14
AI files
Evidence
robots:Claude-Web+FacebookBot+Google-Extended+Amazonbot+Applebot-Extended+CCBot+cohere-ai+GPTBot+anthropic-ai+Bytespider+ClaudeBot+Timpibot+Diffbot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD