Of 89,147 live Mexico websites, only 3,003 (3.37%) block at least one AI crawler in robots.txt. Most site owners have never made a decision about AI at all.
Analysis of 41,818,678 live, content-validated websites worldwide · snapshot 2026-07-13 · by Piperic
Share of sites blocking at least one AI crawler — lower = more open. Mexico ranks #13 of 44 countries analysed.
Neighbours shown for context. Full ranking in the data download.
Every website falls into one of four groups, based on what it blocks and what it declares:
2,764 Mexico websites block GPTBot to keep their content out of AI training. But 112 of them — 4.1% — ALSO block OAI-SearchBot, most likely by accident. Those sites have removed themselves from ChatGPT Search results entirely: protected from training, but invisible where their customers now search.
GPTBot (training) and OAI-SearchBot (ChatGPT Search) are independent robots.txt tokens — blocking one does not block the other.
Share of Mexico sites blocking each crawler in robots.txt.
Bytespider is ByteDance's (TikTok) crawler — it ignores robots.txt more often than the majors, yet it is among the most-blocked.
AI-blocking and llms.txt adoption across Mexico's biggest website categories.
| Sector | Sites | Blocks AI | llms.txt |
|---|---|---|---|
| 📰 News & media | 1,476 | 10.77% | 7.25% |
| business and finance | 26,673 | 2.17% | 5.36% |
| technology and computing | 8,382 | 3.3% | 5.95% |
| home and garden | 5,929 | 2.29% | 12.68% |
| automotive | 3,533 | 2.49% | 11.52% |
| personal finance | 3,514 | 2.56% | 5.41% |
| medical health | 3,468 | 2.6% | 8.68% |
| style and fashion | 3,414 | 2.31% | 46.16% |
| attractions | 3,363 | 13.11% | 4.34% |
| real estate | 3,108 | 3.51% | 5.69% |
| education | 2,945 | 3.02% | 4.72% |
| shopping | 2,627 | 3.39% | 23.6% |
Mexico news sites block AI 3.2× more often than the national average (10.77% vs 3.37%) — publishers are the most defensive segment of the web.
21,404 Mexico online shops are open to AI crawlers (97.2% of 22,012). Their product content can already be read, compared and recommended by AI assistants — whether they know it or not.
Share of sites blocking at least one AI bot, by platform:
This is the baseline edition (2026-07-13). Piperic re-measures continuously; the next edition will show how fast Mexico's web is closing — or opening.
Free, no signup — see your site the way AI crawlers do:
How to cite: “According to Piperic's AI Access Report (2026-07-13), based on 89,147 live Mexico websites…” — link to this page.
Download the country dataset (JSON) Global rankings dataset
Sample: 89,147 live, content-validated websites (Mexico, ccTLD-based assignment), out of 41,818,678 live domains analysed worldwide. “Live” = HTTP 200 and not parked. “Blocks AI” = the site's robots.txt disallows at least one of 14 known AI crawlers. llms.txt/ai.txt = the file exists at the site root. Snapshot: 2026-07-13 (frozen — numbers do not move with the live crawl). Full-web note: these figures cover the ENTIRE live web including the long tail; industry headlines like “25% of top sites block GPTBot” measure only large publishers — both are true, they measure different things. Country assignment via ccTLD under-counts .com/.org sites; treat US figures as indicative.
Press contact: press@piperic.com · Data: Piperic Business Intelligence
Every number on this page is reproducible from the public dataset above.