Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
cohere-aiCCBotGoogle-ExtendedApplebot-ExtendedFacebookBotOmgilibotTimpibotOAI-SearchBotGPTBotAmazonbotClaudeBotDiffbotPerplexityBotImagesiftBotYouBotMeta-ExternalAgentBytespider · 17
AI files
Evidence
robots:cohere-ai+CCBot+Google-Extended+Applebot-Extended+FacebookBot+Omgilibot+Timpibot+OAI-SearchBot+GPTBot+Amazonbot+ClaudeBot+Diffbot+PerplexityBot+ImagesiftBot+YouBot+Meta-ExternalAgent+Bytespider
Compliance (GEO / GDPR)
TLD