Category
Primary
web-development · embed-ft 0.77
Tree path
Technology & Computing › Computing › Internet › Web Development
Group (tier-1)
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderClaudeBotGPTBotImagesiftBotOmgilibotPerplexityBotTimpibotAmazonbotCCBotChatGPT-UserGoogle-ExtendedMeta-ExternalAgentOAI-SearchBotcohere-aiYouBotanthropic-aiApplebot-ExtendedClaude-WebDiffbotFacebookBot · 20
AI files
Evidence
robots:Bytespider+ClaudeBot+GPTBot+ImagesiftBot+Omgilibot+PerplexityBot+Timpibot+Amazonbot+CCBot+ChatGPT-User+Google-Extended+Meta-ExternalAgent+OAI-SearchBot+cohere-ai+YouBot+anthropic-ai+Applebot-Extended+Claude-Web+Diffbot+FacebookBot