Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedChatGPT-UserGoogle-ExtendedYouBotBytespiderMeta-ExternalAgentOmgilibotPerplexityBotClaude-WebDiffbotGPTBotImagesiftBotTimpibotFacebookBotOAI-SearchBotAmazonbotanthropic-aiCCBotClaudeBotcohere-ai · 20
AI files
Evidence
robots:Applebot-Extended+ChatGPT-User+Google-Extended+YouBot+Bytespider+Meta-ExternalAgent+Omgilibot+PerplexityBot+Claude-Web+Diffbot+GPTBot+ImagesiftBot+Timpibot+FacebookBot+OAI-SearchBot+Amazonbot+anthropic-ai+CCBot+ClaudeBot+cohere-ai
Compliance (GEO / GDPR)
TLD