Category
Tech stack
CMS
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
anthropic-aiApplebot-ExtendedBytespiderPerplexityBotGPTBotMeta-ExternalAgentOmgilibotAmazonbotCCBotClaudeBotFacebookBotGoogle-Extended · 12
AI files
Evidence
robots:anthropic-ai+Applebot-Extended+Bytespider+PerplexityBot+GPTBot+Meta-ExternalAgent+Omgilibot+Amazonbot+CCBot+ClaudeBot+FacebookBot+Google-Extended
Compliance (GEO / GDPR)
TLD
Overview
Title
Dev Kothari – Author
Description
Author
Final URL
Language
en (html)
Scanned at
2026-06-21 02:37:45