Category
Tech stack
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
PerplexityBotTimpibotFacebookBotGoogle-ExtendedImagesiftBotYouBotcohere-aiMeta-ExternalAgentOmgilibotGPTBotClaude-WebApplebot-ExtendedChatGPT-UserDiffbotCCBotClaudeBotOAI-SearchBotAmazonbotanthropic-aiBytespider · 20
AI files
Evidence
robots:PerplexityBot+Timpibot+FacebookBot+Google-Extended+ImagesiftBot+YouBot+cohere-ai+Meta-ExternalAgent+Omgilibot+GPTBot+Claude-Web+Applebot-Extended+ChatGPT-User+Diffbot+CCBot+ClaudeBot+OAI-SearchBot+Amazonbot+anthropic-ai+Bytespidermeta:noai
Compliance (GEO / GDPR)
TLD