Category
Primary
web-development · embed-ft 0.37
Tree path
Technology & Computing › Computing › Internet › Web Development
Group (tier-1)
Also (top-3)
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
Applebot-ExtendedClaudeBotanthropic-aicohere-aiCCBotFacebookBotDiffbotYouBotTimpibotAmazonbotPerplexityBotChatGPT-UserClaude-WebOmgilibotBytespiderGoogle-ExtendedGPTBotMeta-ExternalAgentOAI-SearchBotImagesiftBot · 20
AI files
Evidence
robots:Applebot-Extended+ClaudeBot+anthropic-ai+cohere-ai+CCBot+FacebookBot+Diffbot+YouBot+Timpibot+Amazonbot+PerplexityBot+ChatGPT-User+Claude-Web+Omgilibot+Bytespider+Google-Extended+GPTBot+Meta-ExternalAgent+OAI-SearchBot+ImagesiftBot
Compliance (GEO / GDPR)
TLD