Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
AmazonbotApplebot-Extendedcohere-aiGPTBotClaudeBotClaude-WebBytespiderPerplexityBotYouBotGoogle-ExtendedCCBotFacebookBotDiffbotChatGPT-Useranthropic-aiOmgilibot · 16
AI files
Evidence
robots:Amazonbot+Applebot-Extended+cohere-ai+GPTBot+ClaudeBot+Claude-Web+Bytespider+PerplexityBot+YouBot+Google-Extended+CCBot+FacebookBot+Diffbot+ChatGPT-User+anthropic-ai+Omgilibot
Compliance (GEO / GDPR)
TLD