Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderChatGPT-UserImagesiftBotOmgilibotAmazonbotClaudeBotPerplexityBotanthropic-aiFacebookBotTimpibotYouBotApplebot-ExtendedCCBotMeta-ExternalAgentcohere-aiGoogle-ExtendedGPTBotClaude-WebDiffbot · 19
AI files
Evidence
robots:Bytespider+ChatGPT-User+ImagesiftBot+Omgilibot+Amazonbot+ClaudeBot+PerplexityBot+anthropic-ai+FacebookBot+Timpibot+YouBot+Applebot-Extended+CCBot+Meta-ExternalAgent+cohere-ai+Google-Extended+GPTBot+Claude-Web+Diffbot