Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotClaudeBotBytespiderDiffbotImagesiftBotYouBotGPTBotGoogle-ExtendedPerplexityBotFacebookBotanthropic-aiChatGPT-UserClaude-WebOmgilibot · 14
AI files
Evidence
robots:Amazonbot+ClaudeBot+Bytespider+Diffbot+ImagesiftBot+YouBot+GPTBot+Google-Extended+PerplexityBot+FacebookBot+anthropic-ai+ChatGPT-User+Claude-Web+Omgilibot
Compliance (GEO / GDPR)
TLD