Category
Tech stack
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiClaudeBotGPTBotPerplexityBotAmazonbotApplebot-ExtendedBytespiderCCBotFacebookBotGoogle-ExtendedMeta-ExternalAgentOmgilibot · 12
AI files
Evidence
robots:anthropic-ai+ClaudeBot+GPTBot+PerplexityBot+Amazonbot+Applebot-Extended+Bytespider+CCBot+FacebookBot+Google-Extended+Meta-ExternalAgent+Omgilibot
Compliance (GEO / GDPR)
TLD
Overview
Title
Sunset Development Group
Description
A homepage for our real estate development company
Final URL
Language
en (html)
Scanned at
2026-06-27 12:18:40