Of 63,206 live South African websites, 3,376 (5.34%) block an AI crawler — 37th of 43 countries. And its newsrooms top the global table: 25.4% of SA news sites block AI, the highest in this report.
Analysis of 41,818,678 live, content-validated websites worldwide · snapshot 2026-07-13 · by Piperic
South Africa runs a cautious web — 5.34% of its 63,206 live sites block an AI crawler, 37th of 43 countries — but its newsrooms set a world record. 25.4% of South African news sites block AI, the highest press figure in this entire report, narrowly ahead of Australia. Nearly nowhere and no sector is more defensive.
Beyond the press, real estate (10.75%) and attractions (8.32%) lead the sectoral table — both well above the national average. Yet 10.7% of South African sites have consciously opted in with a policy file, and 11% publish llms.txt, so the awareness is there even where the instinct is to protect.
South Africa's blocking is also relatively imprecise: 11.8% of GPTBot-blockers accidentally shut out ChatGPT Search too — roughly double the global 6.1% and among the higher paradox rates outside the German-speaking world. Protection here comes with a visibility cost more often than elsewhere.
Share of sites blocking at least one AI crawler — lower = more open. South Africa ranks #37 of 44 countries analysed.
Neighbours shown for context. Full ranking in the data download.
Every website falls into one of four groups, based on what it blocks and what it declares:
3,000 South Africa websites block GPTBot to keep their content out of AI training. But 355 of them — 11.8% — ALSO block OAI-SearchBot, most likely by accident. Those sites have removed themselves from ChatGPT Search results entirely: protected from training, but invisible where their customers now search.
GPTBot (training) and OAI-SearchBot (ChatGPT Search) are independent robots.txt tokens — blocking one does not block the other.
Share of South Africa sites blocking each crawler in robots.txt.
Bytespider is ByteDance's (TikTok) crawler — it ignores robots.txt more often than the majors, yet it is among the most-blocked.
AI-blocking and llms.txt adoption across South Africa's biggest website categories.
| Sector | Sites | Blocks AI | llms.txt |
|---|---|---|---|
| 📰 News & media | 327 | 25.38% | 7.03% |
| business and finance | 17,168 | 4.26% | 6.24% |
| technology and computing | 6,075 | 6.42% | 6.21% |
| home and garden | 4,003 | 4.4% | 12.62% |
| personal finance | 2,993 | 4.98% | 7.05% |
| travel | 2,967 | 3.57% | 6.98% |
| automotive | 2,803 | 4.96% | 10.63% |
| style and fashion | 2,478 | 3.83% | 46.17% |
| real estate | 2,232 | 10.75% | 3.27% |
| shopping | 2,208 | 4.39% | 35.28% |
| medical health | 1,785 | 3.7% | 8.46% |
| sports | 1,716 | 5.24% | 17.13% |
South Africa news sites block AI 4.8× more often than the national average (25.38% vs 5.34%) — publishers are the most defensive segment of the web.
17,341 South Africa online shops are open to AI crawlers (96.7% of 17,927). Their product content can already be read, compared and recommended by AI assistants — whether they know it or not.
Share of sites blocking at least one AI bot, by platform:
This is the baseline edition (2026-07-13). Piperic re-measures continuously; the next edition will show how fast South Africa's web is closing — or opening.
Free, no signup — see your site the way AI crawlers do:
How to cite: “According to Piperic's AI Access Report (2026-07-13), based on 63,206 live South Africa websites…” — link to this page.
Download the country dataset (JSON) Global rankings dataset
Sample: 63,206 live, content-validated websites (South Africa, ccTLD-based assignment), out of 41,818,678 live domains analysed worldwide. “Live” = HTTP 200 and not parked. “Blocks AI” = the site's robots.txt disallows at least one of 14 known AI crawlers. llms.txt/ai.txt = the file exists at the site root. Snapshot: 2026-07-13 (frozen — numbers do not move with the live crawl). Full-web note: these figures cover the ENTIRE live web including the long tail; industry headlines like “25% of top sites block GPTBot” measure only large publishers — both are true, they measure different things. Country assignment via ccTLD under-counts .com/.org sites; treat US figures as indicative.
Press contact: press@piperic.com · Data: Piperic Business Intelligence
Every number on this page is reproducible from the public dataset above.