Google · AI crawler
2,077,985 websites block Google-Extended
That’s 4.281% of the 48,534,257 live websites we index — the #6 most-blocked AI crawler.
Model trainingRespects robots.txtAI Data Scrapers
Used to train Gemini and Vertex AI generative APIs. Does not impact a site's inclusion or ranking in Google Search.
🛰️ We haven’t observed Google-Extended crawling piperic.com yet. This page updates automatically when it does.
Block Google-Extended in robots.txt
Add this to your site’s /robots.txt:
User-agent: Google-Extended
Disallow: /
Who blocks Google-Extended
Top countries blocking it
Top categories blocking it
← All AI bots