Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedDiffbotPerplexityBotClaude-WebGPTBotTimpibotYouBotBytespiderFacebookBotMeta-ExternalAgentAmazonbotanthropic-aiCCBotChatGPT-UserClaudeBotcohere-aiGoogle-ExtendedOAI-SearchBot · 18
AI files
Evidence
robots:Applebot-Extended+Diffbot+PerplexityBot+Claude-Web+GPTBot+Timpibot+YouBot+Bytespider+FacebookBot+Meta-ExternalAgent+Amazonbot+anthropic-ai+CCBot+ChatGPT-User+ClaudeBot+cohere-ai+Google-Extended+OAI-SearchBot