Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ClaudeBotFacebookBotMeta-ExternalAgentPerplexityBotBytespiderClaude-WebChatGPT-UserOmgilibotApplebot-ExtendedCCBotImagesiftBotOAI-SearchBotTimpibotanthropic-aicohere-aiAmazonbotDiffbotYouBotGPTBotGoogle-Extended · 20
AI files
Evidence
robots:ClaudeBot+FacebookBot+Meta-ExternalAgent+PerplexityBot+Bytespider+Claude-Web+ChatGPT-User+Omgilibot+Applebot-Extended+CCBot+ImagesiftBot+OAI-SearchBot+Timpibot+anthropic-ai+cohere-ai+Amazonbot+Diffbot+YouBot+GPTBot+Google-Extended
Compliance (GEO / GDPR)
TLD