Category
Primary
spam-or-harmful-content · embed-ft 0.39
Tree path
Sensitive Topics › Spam or Harmful Content
Group (tier-1)
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
ClaudeBotFacebookBotMeta-ExternalAgentanthropic-aiApplebot-ExtendedCCBotGPTBotOmgilibotPerplexityBotAmazonbotBytespiderGoogle-Extended · 12
AI files
Evidence
robots:ClaudeBot+FacebookBot+Meta-ExternalAgent+anthropic-ai+Applebot-Extended+CCBot+GPTBot+Omgilibot+PerplexityBot+Amazonbot+Bytespider+Google-Extended
Compliance (GEO / GDPR)
TLD