Category
Tech stack
AI readiness
AI training policy
reserved
Terms of Service
AI-bot protection
Blocked AI bots
ImagesiftBotAmazonbotGPTBotApplebot-ExtendedPerplexityBotYouBotTimpibotCCBotGoogle-ExtendedOmgilibotBytespiderOAI-SearchBotFacebookBotMeta-ExternalAgentDiffbotClaudeBotcohere-ai · 17
AI files
Evidence
robots:ImagesiftBot+Amazonbot+GPTBot+Applebot-Extended+PerplexityBot+YouBot+Timpibot+CCBot+Google-Extended+Omgilibot+Bytespider+OAI-SearchBot+FacebookBot+Meta-ExternalAgent+Diffbot+ClaudeBot+cohere-ai
Compliance (GEO / GDPR)
TLD