Category
Tech stack
CDN
AI readiness
AI training policy
prohibited
AI-bot protection
Blocked AI bots
BytespiderClaudeBotDiffbotChatGPT-UserGoogle-Extendedanthropic-aiFacebookBotOmgilibotGPTBotCCBot · 10
AI files
Evidence
robots:Bytespider+ClaudeBot+Diffbot+ChatGPT-User+Google-Extended+anthropic-ai+FacebookBot+Omgilibot+GPTBot+CCBotx-robots:noai
Compliance (GEO / GDPR)
TLD