Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotImagesiftBotGPTBotApplebot-ExtendedOAI-SearchBotClaudeBotPerplexityBotBytespiderOmgilibotTimpibotChatGPT-Useranthropic-aiClaude-WebYouBotCCBotGoogle-ExtendedMeta-ExternalAgentFacebookBotDiffbotcohere-ai · 20
AI files
Evidence
robots:Amazonbot+ImagesiftBot+GPTBot+Applebot-Extended+OAI-SearchBot+ClaudeBot+PerplexityBot+Bytespider+Omgilibot+Timpibot+ChatGPT-User+anthropic-ai+Claude-Web+YouBot+CCBot+Google-Extended+Meta-ExternalAgent+FacebookBot+Diffbot+cohere-ai
Compliance (GEO / GDPR)
TLD