Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
OAI-SearchBotDiffbotcohere-aiImagesiftBotBytespiderTimpibotClaudeBotYouBotCCBotGoogle-ExtendedApplebot-Extendedanthropic-aiClaude-WebAmazonbotFacebookBotOmgilibotGPTBotChatGPT-UserPerplexityBotMeta-ExternalAgent · 20
AI files
Evidence
robots:OAI-SearchBot+Diffbot+cohere-ai+ImagesiftBot+Bytespider+Timpibot+ClaudeBot+YouBot+CCBot+Google-Extended+Applebot-Extended+anthropic-ai+Claude-Web+Amazonbot+FacebookBot+Omgilibot+GPTBot+ChatGPT-User+PerplexityBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD