Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderCCBotClaudeBotDiffbotPerplexityBotTimpibotAmazonbotApplebot-ExtendedChatGPT-Usercohere-aiGPTBotMeta-ExternalAgentOAI-SearchBotFacebookBotGoogle-Extendedanthropic-aiClaude-WebYouBot · 18
AI files
Evidence
robots:Bytespider+CCBot+ClaudeBot+Diffbot+PerplexityBot+Timpibot+Amazonbot+Applebot-Extended+ChatGPT-User+cohere-ai+GPTBot+Meta-ExternalAgent+OAI-SearchBot+FacebookBot+Google-Extended+anthropic-ai+Claude-Web+YouBot
Compliance (GEO / GDPR)
TLD