Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Amazonbotcohere-aiDiffbotPerplexityBotBytespiderClaudeBotFacebookBotGPTBotImagesiftBotOmgilibotanthropic-aiChatGPT-UserClaude-WebMeta-ExternalAgentOAI-SearchBotTimpibotYouBotApplebot-ExtendedCCBot · 19
AI files
Evidence
robots:Amazonbot+cohere-ai+Diffbot+PerplexityBot+Bytespider+ClaudeBot+FacebookBot+GPTBot+ImagesiftBot+Omgilibot+anthropic-ai+ChatGPT-User+Claude-Web+Meta-ExternalAgent+OAI-SearchBot+Timpibot+YouBot+Applebot-Extended+CCBot
Compliance (GEO / GDPR)
TLD