Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Google-ExtendedPerplexityBotYouBotApplebot-ExtendedClaudeBotGPTBotOAI-SearchBotClaude-WebFacebookBotAmazonbotBytespiderDiffbotMeta-ExternalAgentChatGPT-UserCCBotanthropic-ai · 16
AI files
Evidence
robots:Google-Extended+PerplexityBot+YouBot+Applebot-Extended+ClaudeBot+GPTBot+OAI-SearchBot+Claude-Web+FacebookBot+Amazonbot+Bytespider+Diffbot+Meta-ExternalAgent+ChatGPT-User+CCBot+anthropic-aillms.txt
Compliance (GEO / GDPR)
TLD