Category
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
DiffbotFacebookBotMeta-ExternalAgentOmgilibotApplebot-ExtendedCCBotChatGPT-UserGoogle-ExtendedPerplexityBotTimpibotAmazonbotBytespiderClaude-WebGPTBotImagesiftBotOAI-SearchBotanthropic-aiClaudeBotcohere-aiYouBot · 20
AI files
Evidence
robots:Diffbot+FacebookBot+Meta-ExternalAgent+Omgilibot+Applebot-Extended+CCBot+ChatGPT-User+Google-Extended+PerplexityBot+Timpibot+Amazonbot+Bytespider+Claude-Web+GPTBot+ImagesiftBot+OAI-SearchBot+anthropic-ai+ClaudeBot+cohere-ai+YouBotpage:no-ai-training
Compliance (GEO / GDPR)
TLD