Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
PerplexityBotGoogle-ExtendedDiffbotImagesiftBotTimpibotClaude-WebClaudeBotanthropic-aiFacebookBotGPTBotApplebot-ExtendedAmazonbotcohere-aiOmgilibotChatGPT-UserYouBotCCBotBytespiderMeta-ExternalAgentOAI-SearchBot · 20
AI files
Evidence
robots:PerplexityBot+Google-Extended+Diffbot+ImagesiftBot+Timpibot+Claude-Web+ClaudeBot+anthropic-ai+FacebookBot+GPTBot+Applebot-Extended+Amazonbot+cohere-ai+Omgilibot+ChatGPT-User+YouBot+CCBot+Bytespider+Meta-ExternalAgent+OAI-SearchBot
Compliance (GEO / GDPR)
TLD