Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
CCBotAmazonbotImagesiftBotanthropic-aiClaude-WebPerplexityBotGoogle-ExtendedChatGPT-UserOAI-SearchBotClaudeBotTimpibotGPTBotFacebookBotDiffbotMeta-ExternalAgentcohere-aiOmgilibotYouBotApplebot-ExtendedBytespider · 20
AI files
Evidence
robots:CCBot+Amazonbot+ImagesiftBot+anthropic-ai+Claude-Web+PerplexityBot+Google-Extended+ChatGPT-User+OAI-SearchBot+ClaudeBot+Timpibot+GPTBot+FacebookBot+Diffbot+Meta-ExternalAgent+cohere-ai+Omgilibot+YouBot+Applebot-Extended+Bytespider
Compliance (GEO / GDPR)
TLD