Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Google-ExtendedPerplexityBotanthropic-aicohere-aiDiffbotOmgilibotApplebot-ExtendedChatGPT-UserGPTBotMeta-ExternalAgentTimpibotYouBotAmazonbotClaude-WebFacebookBotImagesiftBotOAI-SearchBotBytespiderCCBotClaudeBot · 20
AI files
Evidence
robots:Google-Extended+PerplexityBot+anthropic-ai+cohere-ai+Diffbot+Omgilibot+Applebot-Extended+ChatGPT-User+GPTBot+Meta-ExternalAgent+Timpibot+YouBot+Amazonbot+Claude-Web+FacebookBot+ImagesiftBot+OAI-SearchBot+Bytespider+CCBot+ClaudeBot
Compliance (GEO / GDPR)
TLD