Webz.io · AI crawler
omgili
Model trainingRespects robots.txtAI Data Scrapers
Crawls sites for APIs used by Hootsuite, Sprinklr, NetBase, and other companies. Data also sold for research purposes or LLM training.
Official documentation ↗
🛰️ We haven’t observed omgili crawling piperic.com yet. This page updates automatically when it does.
Block omgili in robots.txt
Add this to your site’s /robots.txt:
User-agent: omgili
Disallow: /
← All AI bots