Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
DiffbotMeta-ExternalAgentYouBotClaude-WebClaudeBotOAI-SearchBotanthropic-aiApplebot-ExtendedFacebookBotGPTBotGoogle-ExtendedImagesiftBotTimpibotcohere-aiCCBotChatGPT-UserPerplexityBotOmgilibotBytespider · 19
AI files
Evidence
robots:Diffbot+Meta-ExternalAgent+YouBot+Claude-Web+ClaudeBot+OAI-SearchBot+anthropic-ai+Applebot-Extended+FacebookBot+GPTBot+Google-Extended+ImagesiftBot+Timpibot+cohere-ai+CCBot+ChatGPT-User+PerplexityBot+Omgilibot+Bytespider
Compliance (GEO / GDPR)
TLD