Category & trade
Primary
web-development · embed-ft 0.53
Tree path
Technology & Computing › Computing › Internet › Web Development
Group (tier-1)
AI readiness
AI-Readiness score
9 / 100 · not-ready · see similar
AI training policy
reserved
AI-bot protection
Blocked AI bots
AmazonbotChatGPT-UserClaude-WebDiffbotOAI-SearchBotPerplexityBotApplebot-ExtendedClaudeBotanthropic-aicohere-aiFacebookBotGoogle-ExtendedMeta-ExternalAgentOmgilibotTimpibotYouBotBytespiderCCBotGPTBotImagesiftBot · 20
AI files
Evidence
robots:Amazonbot+ChatGPT-User+Claude-Web+Diffbot+OAI-SearchBot+PerplexityBot+Applebot-Extended+ClaudeBot+anthropic-ai+cohere-ai+FacebookBot+Google-Extended+Meta-ExternalAgent+Omgilibot+Timpibot+YouBot+Bytespider+CCBot+GPTBot+ImagesiftBot
Compliance (GEO / GDPR)
TLD
Overview
Title
Avner Shanan's personal website: Homepage
Final URL
Language
en (html)
Scanned at
2026-06-19 00:07:37