Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
DiffbotAmazonbotBytespiderCCBotClaudeBotGoogle-ExtendedClaude-WebFacebookBotImagesiftBotanthropic-aiApplebot-ExtendedChatGPT-UserOmgilibotPerplexityBotOAI-SearchBotGPTBotcohere-ai · 17
AI files
Evidence
robots:Diffbot+Amazonbot+Bytespider+CCBot+ClaudeBot+Google-Extended+Claude-Web+FacebookBot+ImagesiftBot+anthropic-ai+Applebot-Extended+ChatGPT-User+Omgilibot+PerplexityBot+OAI-SearchBot+GPTBot+cohere-ai
Compliance (GEO / GDPR)
TLD