Category
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
CCBotClaude-Webanthropic-aiFacebookBotAmazonbotBytespidercohere-aiDiffbotChatGPT-UserClaudeBotMeta-ExternalAgentPerplexityBotGPTBotGoogle-ExtendedApplebot-Extended · 15
AI files
Evidence
robots:CCBot+Claude-Web+anthropic-ai+FacebookBot+Amazonbot+Bytespider+cohere-ai+Diffbot+ChatGPT-User+ClaudeBot+Meta-ExternalAgent+PerplexityBot+GPTBot+Google-Extended+Applebot-Extendedllms.txt
Compliance (GEO / GDPR)
TLD