Category & trade
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
Meta-ExternalAgentOmgilibotClaudeBotCCBotFacebookBotClaude-WebDiffbotTimpibotPerplexityBotAmazonbotImagesiftBotBytespiderYouBotOAI-SearchBotcohere-aiGPTBotGoogle-ExtendedApplebot-Extended · 18
AI files
Evidence
robots:Meta-ExternalAgent+Omgilibot+ClaudeBot+CCBot+FacebookBot+Claude-Web+Diffbot+Timpibot+PerplexityBot+Amazonbot+ImagesiftBot+Bytespider+YouBot+OAI-SearchBot+cohere-ai+GPTBot+Google-Extended+Applebot-Extendedpage:no-ai-training
Compliance (GEO / GDPR)
TLD