Of 33,801 live Israeli websites, 2,051 (6.07%) block an AI crawler — 43rd of 43 countries. Yet 11% have consciously published an AI policy, one of the highest opt-in rates in the world.
Analysis of 41,818,678 live, content-validated websites worldwide · snapshot 2026-07-13 · by Piperic
Israel presents a genuine paradox. Of 33,801 live Israeli sites, 6.07% block an AI crawler — 43rd of 43 countries on the headline number, one of the most cautious in the survey. Yet Israel also has one of the world's highest rates of conscious engagement: 11.2% have published an AI policy file and 11.87% an llms.txt.
So Israel isn't cautious by accident. Its blocking is deliberate, its opt-in is deliberate — the 'start-up nation' has simply engaged with the AI question more than most, and reached a more protective conclusion. Shopping (7.29%) and technology (7.14%) lead the sectoral table, and the press is moderate at 7.9%.
The blocking is also precise: only 3.7% of GPTBot-blockers accidentally lost ChatGPT Search, well below the global 6.1%. Israel's profile is unusual — high caution and high awareness together, a web that has decided rather than drifted.
Share of sites blocking at least one AI crawler — lower = more open. Israel ranks #43 of 44 countries analysed.
Neighbours shown for context. Full ranking in the data download.
Every website falls into one of four groups, based on what it blocks and what it declares:
1,952 Israel websites block GPTBot to keep their content out of AI training. But 73 of them — 3.7% — ALSO block OAI-SearchBot, most likely by accident. Those sites have removed themselves from ChatGPT Search results entirely: protected from training, but invisible where their customers now search.
GPTBot (training) and OAI-SearchBot (ChatGPT Search) are independent robots.txt tokens — blocking one does not block the other.
Share of Israel sites blocking each crawler in robots.txt.
Bytespider is ByteDance's (TikTok) crawler — it ignores robots.txt more often than the majors, yet it is among the most-blocked.
AI-blocking and llms.txt adoption across Israel's biggest website categories.
| Sector | Sites | Blocks AI | llms.txt |
|---|---|---|---|
| 📰 News & media | 329 | 7.9% | 8.51% |
| business and finance | 6,292 | 5.13% | 10.01% |
| home and garden | 2,808 | 6.09% | 14.0% |
| technology and computing | 2,788 | 7.14% | 9.43% |
| medical health | 1,707 | 6.44% | 13.3% |
| style and fashion | 1,606 | 6.16% | 30.32% |
| personal finance | 1,481 | 6.28% | 9.86% |
| shopping | 1,467 | 7.29% | 15.06% |
| healthy living | 1,096 | 5.11% | 11.22% |
| law | 1,068 | 4.78% | 12.27% |
| family and relationships | 969 | 4.33% | 11.35% |
| travel | 949 | 5.37% | 11.59% |
Israel news sites block AI 1.3× more often than the national average (7.9% vs 6.07%) — publishers are the most defensive segment of the web.
8,620 Israel online shops are open to AI crawlers (93.4% of 9,230). Their product content can already be read, compared and recommended by AI assistants — whether they know it or not.
Share of sites blocking at least one AI bot, by platform:
This is the baseline edition (2026-07-13). Piperic re-measures continuously; the next edition will show how fast Israel's web is closing — or opening.
Free, no signup — see your site the way AI crawlers do:
How to cite: “According to Piperic's AI Access Report (2026-07-13), based on 33,801 live Israel websites…” — link to this page.
Download the country dataset (JSON) Global rankings dataset
Sample: 33,801 live, content-validated websites (Israel, ccTLD-based assignment), out of 41,818,678 live domains analysed worldwide. “Live” = HTTP 200 and not parked. “Blocks AI” = the site's robots.txt disallows at least one of 14 known AI crawlers. llms.txt/ai.txt = the file exists at the site root. Snapshot: 2026-07-13 (frozen — numbers do not move with the live crawl). Full-web note: these figures cover the ENTIRE live web including the long tail; industry headlines like “25% of top sites block GPTBot” measure only large publishers — both are true, they measure different things. Country assignment via ccTLD under-counts .com/.org sites; treat US figures as indicative.
Press contact: press@piperic.com · Data: Piperic Business Intelligence
Every number on this page is reproducible from the public dataset above.