Category
Tech stack
Framework
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
FacebookBotImagesiftBotYouBotClaudeBotcohere-aiGPTBotPerplexityBotClaude-WebApplebot-ExtendedBytespiderCCBotDiffbotOmgilibotAmazonbotChatGPT-UserGoogle-Extendedanthropic-ai · 17
AI files
Evidence
robots:FacebookBot+ImagesiftBot+YouBot+ClaudeBot+cohere-ai+GPTBot+PerplexityBot+Claude-Web+Applebot-Extended+Bytespider+CCBot+Diffbot+Omgilibot+Amazonbot+ChatGPT-User+Google-Extended+anthropic-ai
Compliance (GEO / GDPR)
TLD