Category
Tech stack
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
OmgilibotDiffbotChatGPT-UserClaudeBotPerplexityBotCCBotFacebookBotBytespiderYouBotcohere-aiGPTBotanthropic-aiGoogle-ExtendedApplebot-Extended · 14
AI files
Evidence
robots:Omgilibot+Diffbot+ChatGPT-User+ClaudeBot+PerplexityBot+CCBot+FacebookBot+Bytespider+YouBot+cohere-ai+GPTBot+anthropic-ai+Google-Extended+Applebot-Extendedmeta:noai
Compliance (GEO / GDPR)
TLD