Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aicohere-aiAmazonbotCCBotDiffbotGoogle-ExtendedMeta-ExternalAgentOAI-SearchBotOmgilibotPerplexityBotBytespiderYouBotTimpibotClaudeBotChatGPT-UserClaude-WebFacebookBotGPTBotImagesiftBotApplebot-Extended · 20
AI files
Evidence
robots:anthropic-ai+cohere-ai+Amazonbot+CCBot+Diffbot+Google-Extended+Meta-ExternalAgent+OAI-SearchBot+Omgilibot+PerplexityBot+Bytespider+YouBot+Timpibot+ClaudeBot+ChatGPT-User+Claude-Web+FacebookBot+GPTBot+ImagesiftBot+Applebot-Extended
Compliance (GEO / GDPR)
TLD