Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Claude-WebAmazonbotDiffbotTimpibotGPTBotClaudeBotPerplexityBotApplebot-ExtendedCCBotYouBotChatGPT-Usercohere-aiBytespiderOAI-SearchBotanthropic-aiGoogle-ExtendedMeta-ExternalAgent · 17
AI files
Evidence
robots:Claude-Web+Amazonbot+Diffbot+Timpibot+GPTBot+ClaudeBot+PerplexityBot+Applebot-Extended+CCBot+YouBot+ChatGPT-User+cohere-ai+Bytespider+OAI-SearchBot+anthropic-ai+Google-Extended+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD