Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedDiffbotFacebookBotMeta-ExternalAgentChatGPT-UserGoogle-ExtendedPerplexityBotImagesiftBotanthropic-aiCCBotOmgilibotGPTBotOAI-SearchBotClaudeBotClaude-WebBytespiderAmazonbotcohere-aiYouBot · 19
AI files
Evidence
robots:Applebot-Extended+Diffbot+FacebookBot+Meta-ExternalAgent+ChatGPT-User+Google-Extended+PerplexityBot+ImagesiftBot+anthropic-ai+CCBot+Omgilibot+GPTBot+OAI-SearchBot+ClaudeBot+Claude-Web+Bytespider+Amazonbot+cohere-ai+YouBot
Compliance (GEO / GDPR)
TLD