Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
YouBotAmazonbotBytespiderCCBotClaudeBotOAI-SearchBotPerplexityBotanthropic-aiClaude-Webcohere-aiGoogle-ExtendedApplebot-ExtendedDiffbotMeta-ExternalAgentChatGPT-UserFacebookBotGPTBotTimpibot · 18
AI files
Evidence
robots:YouBot+Amazonbot+Bytespider+CCBot+ClaudeBot+OAI-SearchBot+PerplexityBot+anthropic-ai+Claude-Web+cohere-ai+Google-Extended+Applebot-Extended+Diffbot+Meta-ExternalAgent+ChatGPT-User+FacebookBot+GPTBot+Timpibot
Compliance (GEO / GDPR)
TLD