Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
GPTBotPerplexityBotAmazonbotCCBotFacebookBotGoogle-ExtendedClaude-WebApplebot-Extendedcohere-aiDiffbotMeta-ExternalAgentImagesiftBotanthropic-aiClaudeBotBytespiderChatGPT-User · 16
AI files
Evidence
robots:GPTBot+PerplexityBot+Amazonbot+CCBot+FacebookBot+Google-Extended+Claude-Web+Applebot-Extended+cohere-ai+Diffbot+Meta-ExternalAgent+ImagesiftBot+anthropic-ai+ClaudeBot+Bytespider+ChatGPT-User
Compliance (GEO / GDPR)
TLD