Category & trade
Tech stack
CDN
AI readiness
AI-Readiness score
53 / 100 · ready · see similar
AI training policy
reserved
AI-bot protection
Blocked AI bots
BytespiderMeta-ExternalAgentGoogle-ExtendedApplebot-ExtendedPerplexityBotcohere-aiFacebookBotGPTBotOAI-SearchBotClaudeBotClaude-WebDiffbotChatGPT-UserYouBotAmazonbotImagesiftBotanthropic-aiCCBot · 18
AI files
Evidence
robots:Bytespider+Meta-ExternalAgent+Google-Extended+Applebot-Extended+PerplexityBot+cohere-ai+FacebookBot+GPTBot+OAI-SearchBot+ClaudeBot+Claude-Web+Diffbot+ChatGPT-User+YouBot+Amazonbot+ImagesiftBot+anthropic-ai+CCBotllms.txt
Compliance (GEO / GDPR)
TLD
Overview
Title
Austin Cribs — Celebrity Homes, Luxury Estates & The Coolest Houses in Austin, Texas
Description
Inside Austin
Final URL
Language
en (html)
Scanned at
2026-06-19 03:02:18