Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
FacebookBotGPTBotChatGPT-UserPerplexityBotCCBotGoogle-ExtendedAmazonbotApplebot-ExtendedClaudeBotanthropic-aiYouBotMeta-ExternalAgentBytespiderDiffbotcohere-ai · 15
AI files
Evidence
robots:FacebookBot+GPTBot+ChatGPT-User+PerplexityBot+CCBot+Google-Extended+Amazonbot+Applebot-Extended+ClaudeBot+anthropic-ai+YouBot+Meta-ExternalAgent+Bytespider+Diffbot+cohere-ai
Compliance (GEO / GDPR)
TLD