Category
Tech stack
E-commerce
Payment
Analytics
CDN
Framework
Consent/CMP
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
Applebot-Extendedanthropic-aiBytespidercohere-aiDiffbotOmgilibotTimpibotAmazonbotGoogle-ExtendedCCBotClaudeBotImagesiftBotGPTBotMeta-ExternalAgent · 14
AI files
Evidence
robots:Applebot-Extended+anthropic-ai+Bytespider+cohere-ai+Diffbot+Omgilibot+Timpibot+Amazonbot+Google-Extended+CCBot+ClaudeBot+ImagesiftBot+GPTBot+Meta-ExternalAgent
Compliance (GEO / GDPR)
TLD