Piperic
AI Access Report
AI Report
🌍 The AI Access Report · 2026-07-13

🇮🇩 Indonesia is the most AI-defensive web in the survey — led by education and tourism

Of 28,218 live Indonesian websites, 2,970 (10.53%) block an AI crawler — the highest of all 43 countries. Education (14.9%) and attractions (14.4%) lead, and its news sites block at 15%.

Analysis of 41,818,678 live, content-validated websites worldwide · snapshot 2026-07-13 · by Piperic

Share:XLinkedIn

89.5%open to AI crawlers

Indonesia stands at the defensive end of the entire report. Of 28,218 live Indonesian sites, 10.53% block an AI crawler — the highest figure of all 43 countries, roughly three times the global norm and well clear of the next most cautious markets.

The Indonesian pattern is distinctive: education (14.92%) and attractions (14.39%) lead the sectoral table, alongside a defensive press (14.88%). It is one of the few webs where schools and learning sites, not just journalism or tourism, are among the most guarded against AI.

Yet Indonesian blocking is broad rather than precise in intent: only 1.2% of GPTBot-blockers accidentally lost ChatGPT Search — the second-lowest accidental rate in the report — meaning the high blocking is deliberate, not a firewall accident. With 84.6% of the web still silent, the caution comes from a large, decided defensive minority.

The three numbers that matter

89.5%
AI Training Exposure
share of sites NOT blocking any AI training bot (GPTBot, ClaudeBot, CCBot…) — their content can be used for model training.
99.54%
AI Search Visibility
share of sites reachable by AI search crawlers (OAI-SearchBot, PerplexityBot…) — they can appear in AI answers.
15.54%
AI Policy Maturity
share of sites with ANY conscious, machine-readable AI signal (llms.txt, ai.txt, robots AI rules, ToS clause). Low = the web hasn't decided yet.

Where Indonesia stands in the world

Share of sites blocking at least one AI crawler — lower = more open. Indonesia ranks #44 of 44 countries analysed.

#1 🇯🇵 Japan1.0%#2 🇨🇳 China1.08%#3 🇩🇪 Germany1.58%#4 🇦🇹 Austria1.82%#5 🇷🇺 Russia1.85%#6 🇫🇷 France2.14%#7 🇧🇪 Belgium2.23%#8 🇪🇪 Estonia2.66%#44 🇮🇩 Indonesia10.53%

Neighbours shown for context. Full ranking in the data download.

💬 44th (last) on openness — the most AI-defensive web in the survey, blocking at roughly 3x the global average.

The four AI postures of Indonesia's web

Every website falls into one of four groups, based on what it blocks and what it declares:

84.65%
Open by silence
doesn't block AI and declares nothing — no decision has been made. This is the real story: the vast majority.
4.83%
Consciously open
doesn't block AI and publishes an explicit policy file (llms.txt / ai.txt) — a deliberate yes.
10.06%
Controlled access
blocks training bots but stays visible to AI search — the technically mature strategy.
0.46%
AI-dark
blocks AI search crawlers too — protected, but disappearing from AI answers.
Open by silence: 84.65%Consciously open: 4.83%Controlled access: 10.06%AI-dark: 0.46%84.65%Open by silence
💬 84.65% silent, 4.83% consciously open — but the blocking minority is the largest in the report, which is what pushes Indonesia to the top of the defensive table.

The ChatGPT-invisibility paradox

2,839GPTBot ⛔
34+ OAI-SearchBot ⛔
1.2%ChatGPT Search ✕

2,839 Indonesia websites block GPTBot to keep their content out of AI training. But 34 of them — 1.2% — ALSO block OAI-SearchBot, most likely by accident. Those sites have removed themselves from ChatGPT Search results entirely: protected from training, but invisible where their customers now search.

GPTBot (training) and OAI-SearchBot (ChatGPT Search) are independent robots.txt tokens — blocking one does not block the other.

💬 1.2% accidental self-exclusion — second lowest anywhere. The high blocking is deliberate, not a misfire.

Which AI bots does Indonesia block?

Share of Indonesia sites blocking each crawler in robots.txt.

ClaudeBot10.11%GPTBot10.06%CCBot10.04%Amazonbot10.03%Bytespider · TikTok9.91%Meta-ExternalAgent9.81%Google-Extended9.78%Applebot-Extended9.71%ChatGPT-User0.37%

Bytespider is ByteDance's (TikTok) crawler — it ignores robots.txt more often than the majors, yet it is among the most-blocked.

Industry by industry: who blocks, who doesn't

AI-blocking and llms.txt adoption across Indonesia's biggest website categories.

SectorSitesBlocks AIllms.txt
📰 News & media1,44514.88%11.42%
business and finance7,5357.52%4.17%
technology and computing4,03110.89%4.84%
education1,79014.92%4.02%
attractions1,70914.39%3.74%
personal finance1,3148.6%3.27%
politics1,11112.42%6.48%
shopping99013.74%6.97%
religion and spirituality94013.19%5.43%
automotive86810.48%6.8%
home and garden8578.05%7.23%
style and fashion7846.76%21.3%

Indonesia news sites block AI 1.4× more often than the national average (14.88% vs 10.53%) — publishers are the most defensive segment of the web.

💬 An unusual lead: education (14.92%) and attractions (14.39%) top the table alongside the press (14.88%). Learning sites among the most guarded is rare.

The e-commerce exposure

4,252 Indonesia online shops are open to AI crawlers (90.1% of 4,719). Their product content can already be read, compared and recommended by AI assistants — whether they know it or not.

Platform matters

Share of sites blocking at least one AI bot, by platform:

10.96%WordPress4.49%Shopify10.53%country average

The trend starts here

This is the baseline edition (2026-07-13). Piperic re-measures continuously; the next edition will show how fast Indonesia's web is closing — or opening.

💬 Indonesia begins as the survey's most defensive web, led deliberately by education and tourism. The next edition tracks whether that caution holds or eases.

Check your own website

Free, no signup — see your site the way AI crawlers do:

For journalists — press kit

“Indonesia is the most AI-defensive web in our entire survey — more than one in ten sites blocks. And unusually, it's education and tourism, not the press, driving it. But where Indonesia blocks, it blocks almost by accident: the settings are broad, not surgical,”
— said Attila Rácz-Akácosi, founder of Piperic.

How to cite: “According to Piperic's AI Access Report (2026-07-13), based on 28,218 live Indonesia websites…” — link to this page.

Download the country dataset (JSON) Global rankings dataset

Methodology

Sample: 28,218 live, content-validated websites (Indonesia, ccTLD-based assignment), out of 41,818,678 live domains analysed worldwide. “Live” = HTTP 200 and not parked. “Blocks AI” = the site's robots.txt disallows at least one of 14 known AI crawlers. llms.txt/ai.txt = the file exists at the site root. Snapshot: 2026-07-13 (frozen — numbers do not move with the live crawl). Full-web note: these figures cover the ENTIRE live web including the long tail; industry headlines like “25% of top sites block GPTBot” measure only large publishers — both are true, they measure different things. Country assignment via ccTLD under-counts .com/.org sites; treat US figures as indicative.

Press contact: press@piperic.com · Data: Piperic Business Intelligence

Every number on this page is reproducible from the public dataset above.

Country reports

🌍 Worldwide🇩🇪 Germany🇷🇺 Russia🇬🇧 United Kingdom🇳🇱 Netherlands🇫🇷 France🇧🇷 Brazil🇨🇭 Switzerland🇯🇵 Japan🇵🇱 Poland🇦🇺 Australia🇸🇪 Sweden🇨🇳 China🇮🇹 Italy🇨🇦 Canada🇨🇿 Czechia🇧🇪 Belgium🇦🇹 Austria🇪🇸 Spain🇮🇳 India🇨🇴 Colombia🇸🇰 Slovakia🇩🇰 Denmark🇭🇺 Hungary🇲🇽 Mexico🇳🇴 Norway🇰🇷 South Korea🇦🇷 Argentina🇳🇿 New Zealand🇫🇮 Finland🇬🇷 Greece🇺🇦 Ukraine🇨🇱 Chile🇿🇦 South Africa🇷🇴 Romania🇻🇳 Vietnam🇹🇷 Turkey🇪🇪 Estonia🇵🇹 Portugal🇹🇼 Taiwan🇮🇪 Ireland🇮🇱 Israel🇮🇩 Indonesia🇱🇹 Lithuania