Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ChatGPT-UserDiffbotPerplexityBotOmgilibotanthropic-aiCCBotClaude-WebGPTBotImagesiftBotMeta-ExternalAgentOAI-SearchBotAmazonbotApplebot-ExtendedTimpibotBytespiderClaudeBotcohere-aiFacebookBotGoogle-ExtendedYouBot · 20
AI files
Evidence
robots:ChatGPT-User+Diffbot+PerplexityBot+Omgilibot+anthropic-ai+CCBot+Claude-Web+GPTBot+ImagesiftBot+Meta-ExternalAgent+OAI-SearchBot+Amazonbot+Applebot-Extended+Timpibot+Bytespider+ClaudeBot+cohere-ai+FacebookBot+Google-Extended+YouBot
Compliance (GEO / GDPR)
TLD