Category
Tech stack
CDN
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
FacebookBotBytespiderMeta-ExternalAgentYouBotCCBotChatGPT-UserOmgilibotcohere-aiTimpibotGoogle-ExtendedApplebot-ExtendedClaudeBotDiffbotImagesiftBotPerplexityBotGPTBotanthropic-ai · 17
AI files
Evidence
robots:FacebookBot+Bytespider+Meta-ExternalAgent+YouBot+CCBot+ChatGPT-User+Omgilibot+cohere-ai+Timpibot+Google-Extended+Applebot-Extended+ClaudeBot+Diffbot+ImagesiftBot+PerplexityBot+GPTBot+anthropic-ai
Compliance (GEO / GDPR)
TLD