Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
CCBotGPTBotDiffbotanthropic-aiChatGPT-Usercohere-aiFacebookBotOAI-SearchBotAmazonbotBytespiderClaudeBotGoogle-ExtendedMeta-ExternalAgentTimpibotApplebot-ExtendedClaude-WebImagesiftBotOmgilibotPerplexityBotYouBot · 20
AI files
Evidence
robots:CCBot+GPTBot+Diffbot+anthropic-ai+ChatGPT-User+cohere-ai+FacebookBot+OAI-SearchBot+Amazonbot+Bytespider+ClaudeBot+Google-Extended+Meta-ExternalAgent+Timpibot+Applebot-Extended+Claude-Web+ImagesiftBot+Omgilibot+PerplexityBot+YouBot
Compliance (GEO / GDPR)
TLD