Category
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
Claude-WebAmazonbotBytespiderChatGPT-UserImagesiftBotApplebot-ExtendedGPTBotFacebookBotPerplexityBotMeta-ExternalAgentcohere-aiTimpibotanthropic-aiOAI-SearchBotCCBotDiffbotClaudeBotYouBotGoogle-Extended · 19
AI files
Evidence
robots:Claude-Web+Amazonbot+Bytespider+ChatGPT-User+ImagesiftBot+Applebot-Extended+GPTBot+FacebookBot+PerplexityBot+Meta-ExternalAgent+cohere-ai+Timpibot+anthropic-ai+OAI-SearchBot+CCBot+Diffbot+ClaudeBot+YouBot+Google-Extended
Compliance (GEO / GDPR)
TLD