Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
Claude-Webcohere-aiGoogle-ExtendedGPTBotMeta-ExternalAgentOAI-SearchBotApplebot-Extendedanthropic-aiBytespiderCCBotChatGPT-UserClaudeBotFacebookBotImagesiftBotAmazonbotTimpibotYouBotOmgilibotPerplexityBotDiffbot · 20
AI files
Evidence
robots:Claude-Web+cohere-ai+Google-Extended+GPTBot+Meta-ExternalAgent+OAI-SearchBot+Applebot-Extended+anthropic-ai+Bytespider+CCBot+ChatGPT-User+ClaudeBot+FacebookBot+ImagesiftBot+Amazonbot+Timpibot+YouBot+Omgilibot+PerplexityBot+Diffbot
Compliance (GEO / GDPR)
TLD