Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentOmgilibotChatGPT-UserClaudeBotYouBotGoogle-ExtendedBytespiderApplebot-Extendedanthropic-aiFacebookBotDiffbotcohere-aiImagesiftBotAmazonbotTimpibotGPTBotOAI-SearchBotClaude-WebPerplexityBotCCBot · 20
AI files
Evidence
robots:Meta-ExternalAgent+Omgilibot+ChatGPT-User+ClaudeBot+YouBot+Google-Extended+Bytespider+Applebot-Extended+anthropic-ai+FacebookBot+Diffbot+cohere-ai+ImagesiftBot+Amazonbot+Timpibot+GPTBot+OAI-SearchBot+Claude-Web+PerplexityBot+CCBot
Compliance (GEO / GDPR)
TLD