Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
DiffbotYouBotGPTBotBytespideranthropic-aiClaude-WebChatGPT-UserGoogle-ExtendedPerplexityBotClaudeBotAmazonbotOmgilibotFacebookBotImagesiftBot · 14
AI files
Evidence
robots:Diffbot+YouBot+GPTBot+Bytespider+anthropic-ai+Claude-Web+ChatGPT-User+Google-Extended+PerplexityBot+ClaudeBot+Amazonbot+Omgilibot+FacebookBot+ImagesiftBot
Compliance (GEO / GDPR)
TLD