Category
AI readiness
AI training policy
reserved
AI-bot protection
Blocked AI bots
cohere-aiGPTBotCCBotClaude-WebClaudeBotApplebot-ExtendedBytespiderYouBotTimpibotanthropic-aiFacebookBotImagesiftBotPerplexityBotMeta-ExternalAgentOmgilibotAmazonbotChatGPT-UserDiffbotGoogle-Extended · 19
AI files
Evidence
robots:cohere-ai+GPTBot+CCBot+Claude-Web+ClaudeBot+Applebot-Extended+Bytespider+YouBot+Timpibot+anthropic-ai+FacebookBot+ImagesiftBot+PerplexityBot+Meta-ExternalAgent+Omgilibot+Amazonbot+ChatGPT-User+Diffbot+Google-Extended
Compliance (GEO / GDPR)
TLD
Overview
Title
The Verge
Description
The Verge is about technology and how it makes us feel. Founded in 2011, we offer our audience everything from breaking news to reviews to award-winning features and investigations, on our site, in video, and in podcasts.
Final URL
Language
en (html)
Scanned at
2026-06-27 23:07:01