Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
GPTBotOAI-SearchBotAmazonbotanthropic-aiChatGPT-UserFacebookBotClaude-WebClaudeBotcohere-aiDiffbotGoogle-ExtendedPerplexityBotApplebot-ExtendedBytespiderTimpibotYouBotCCBotMeta-ExternalAgent · 18
AI files
Evidence
robots:GPTBot+OAI-SearchBot+Amazonbot+anthropic-ai+ChatGPT-User+FacebookBot+Claude-Web+ClaudeBot+cohere-ai+Diffbot+Google-Extended+PerplexityBot+Applebot-Extended+Bytespider+Timpibot+YouBot+CCBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD