Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiBytespiderGoogle-ExtendedPerplexityBotAmazonbotDiffbotGPTBotChatGPT-UserFacebookBotYouBotClaudeBotClaude-WebImagesiftBotOmgilibot · 14
AI files
Evidence
robots:anthropic-ai+Bytespider+Google-Extended+PerplexityBot+Amazonbot+Diffbot+GPTBot+ChatGPT-User+FacebookBot+YouBot+ClaudeBot+Claude-Web+ImagesiftBot+Omgilibot
Compliance (GEO / GDPR)
TLD