Category
Tech stack
Framework
AI readiness
AI training policy
prohibited
Terms of Service
AI-bot protection
Blocked AI bots
ClaudeBotOmgilibotImagesiftBotYouBotPerplexityBotAmazonbotFacebookBotBytespiderClaude-WebDiffbotGPTBotanthropic-aiChatGPT-UserGoogle-Extended · 14
AI files
Evidence
robots:ClaudeBot+Omgilibot+ImagesiftBot+YouBot+PerplexityBot+Amazonbot+FacebookBot+Bytespider+Claude-Web+Diffbot+GPTBot+anthropic-ai+ChatGPT-User+Google-Extendedmeta:noai
Compliance (GEO / GDPR)
TLD