Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ChatGPT-UserPerplexityBotImagesiftBotMeta-ExternalAgentAmazonbotClaudeBotOmgilibotFacebookBotBytespiderGPTBotGoogle-ExtendedClaude-WebCCBotanthropic-aiDiffbotYouBot · 16
AI files
Evidence
robots:ChatGPT-User+PerplexityBot+ImagesiftBot+Meta-ExternalAgent+Amazonbot+ClaudeBot+Omgilibot+FacebookBot+Bytespider+GPTBot+Google-Extended+Claude-Web+CCBot+anthropic-ai+Diffbot+YouBot
Compliance (GEO / GDPR)
TLD