AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ImagesiftBotOmgilibotAmazonbotFacebookBotGPTBotPerplexityBotBytespiderClaude-WebDiffbotcohere-aiGoogle-ExtendedMeta-ExternalAgentYouBotanthropic-aiCCBotChatGPT-UserTimpibotApplebot-ExtendedClaudeBotOAI-SearchBot · 20
AI files
Evidence
robots:ImagesiftBot+Omgilibot+Amazonbot+FacebookBot+GPTBot+PerplexityBot+Bytespider+Claude-Web+Diffbot+cohere-ai+Google-Extended+Meta-ExternalAgent+YouBot+anthropic-ai+CCBot+ChatGPT-User+Timpibot+Applebot-Extended+ClaudeBot+OAI-SearchBot
Compliance (GEO / GDPR)
TLD