Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotBytespiderMeta-ExternalAgentClaudeBotGPTBotOAI-SearchBotOmgilibotApplebot-ExtendedDiffbotImagesiftBotPerplexityBotYouBotFacebookBotGoogle-ExtendedTimpibotanthropic-aiCCBotChatGPT-UserClaude-Webcohere-ai · 20
AI files
Evidence
robots:Amazonbot+Bytespider+Meta-ExternalAgent+ClaudeBot+GPTBot+OAI-SearchBot+Omgilibot+Applebot-Extended+Diffbot+ImagesiftBot+PerplexityBot+YouBot+FacebookBot+Google-Extended+Timpibot+anthropic-ai+CCBot+ChatGPT-User+Claude-Web+cohere-ai
Compliance (GEO / GDPR)
TLD