Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Meta-ExternalAgentDiffbotPerplexityBotApplebot-ExtendedBytespiderAmazonbotTimpibotChatGPT-UserOAI-SearchBotYouBotcohere-aiClaude-WebCCBotFacebookBotGoogle-ExtendedImagesiftBotOmgilibotGPTBotClaudeBotanthropic-ai · 20
AI files
Evidence
robots:Meta-ExternalAgent+Diffbot+PerplexityBot+Applebot-Extended+Bytespider+Amazonbot+Timpibot+ChatGPT-User+OAI-SearchBot+YouBot+cohere-ai+Claude-Web+CCBot+FacebookBot+Google-Extended+ImagesiftBot+Omgilibot+GPTBot+ClaudeBot+anthropic-ai
Compliance (GEO / GDPR)
TLD