Lyrenth that builds an AI-readable index of web content for AI systems · AI crawler
AIWebIndex
Data resellerUnclearAI Data Providers
AIWebIndex is a web crawler operated by Lyrenth that builds an AI-readable index of web content for AI systems.
🛰️ We haven’t observed AIWebIndex crawling piperic.com yet. This page updates automatically when it does.
Block AIWebIndex in robots.txt
Add this to your site’s /robots.txt:
User-agent: AIWebIndex
Disallow: /
← All AI bots