Piperic
live · 47,792,638 domains
Export Lead List
Browse
CategoriesAll →
web-hosting3.5Mcasinos-and-gambling1.9Mmarketing-and-advertising1.0Mshopping932kartificial-intelligence914kbusiness816k
TechnologiesAll →
jQuery25.8MGoogle Fonts20.7MWordPress17.9MCloudflare16.5MGoogle Analytics14.3MGoogle Tag Manager13.2M
CountriesAll →
Germany3.8MRussia1.6MUnited Kingdom996kNetherlands973kFrance675kSwitzerland636k
LanguagesAll →
English29.0MGerman5.8MChinese2.4MFrench2.3MSpanish2.1MRussian2.0M
PricingAI Report
Tools
🚀Submit Your Site to AIPush your URL to AI search engines🛰️AI Bot ObservatoryEvery AI crawler & who blocks it🤖AI Crawler CheckerSee which AI bots your site blocks🎯AI Readiness CheckerScore your site 0–100 for AI🔗Backlink CheckerWho links to any site — freeAll tools →
Browse free →

Websites blocking Diffbot

139,562 websites that block the Diffbot AI crawler via robots.txt. Find AI-protective domains and export the dataset.

Export 139,562 leads →in CSV · JSON · XLSX · browse free
Reset
Filters & segments 1

Category

Geo / Compliance

Technology

Contact

⭐ AI rights

Signals

Link graph

Reset
139,562 resultsBlocked bot: Diffbot×Clear all
DomainHTTPTitleCountry/LangCategoryAI filesContactAI-protection
0day.net ↗ 200 DEF CON® Hacking Conference Home en information-and-network-security robotsllmsaihumans emailphone full · 20
0ffline.studio ↗ 200 0FFLINE en musicX-Cart robotsllmsaihumans emailphone partial · 14
0gds.com ↗ 200 马德里竞技直播_马德里竞技比赛免费在线观看_马德里竞技实时弹幕互动直播- 24直播网 zh soccer robotsllmsaihumans emailphone partial · 14
0haswell.com ↗ 200 0 Haswell Street, Daniel Island, SC United States~ en land-and-farms robotsllmsaihumans emailphone partial · 16
0nmcp.com ↗ 200 0nMCP — The Universal AI API Orchestrator en artificial-intelligence robotsllmsaihumans emailphone full · 16
0porn.cc ↗ 200 Free Porn videos, XXX Sex Movies en adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0porn.net ↗ 200 Free Porn videos, XXX Sex Movies en adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0pornoonlines.net ↗ 200 Смотреть порно онлайн, Домашний секс и студийные ролики ru adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0pornos.one ↗ 200 Порно, Секс Видео Онлайн Без регистрации ru adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0pornovideo.net ↗ 200 Порно видео - Лучшие секс ролики с девушками ru adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0pornovideo.one ↗ 200 Порно видео - Лучшие секс ролики с девушками ru adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0pornovideo.org ↗ 200 Порно видео - Лучшие секс ролики с девушками ru adult-and-explicit-sexual-content robotsllmsaihumans emailphone full · 15
0rangerroad.com ↗ 200 0 Ranger Road, Fallbrook, CA en real-estate-buying-and-selling robotsllmsaihumans emailphone partial · 16
0tgdr.makeup ↗ 200 每日主题大赛视频入口 - 高清影视视频精品分享平台｜原创短片｜热门视频合集 zh movies robotsllmsaihumans emailphone partial · 12
0ulhy.makeup ↗ 200 每日主题大赛视频合集 - 高清影视资源导航平台｜热门视频合集｜在线播放推荐 zh movies robotsllmsaihumans emailphone partial · 12
0x.org ↗ 200 0x | Powerful APIs to build financial apps on crypto rails en currencies robotsllmsaihumans emailphone full · 19
0x.org ↗ 200 0x | Powerful APIs to build financial apps on crypto rails en currencies robotsllmsaihumans emailphone full · 19
1-byte.com ↗ 200 First byte | 論理と心理で、判断の質を高める ja management-consulting-industry robotsllmsaihumans emailphone partial · 16
1000-union.com ↗ 200 1000 Union Ave, 401, Seattle, WA en real-estate-buying-and-selling robotsllmsaihumans emailphone partial · 16
1000carterfield.com ↗ 200 Buckhorn Road #1000, Ashland, OR United States~ en land-and-farms robotsllmsaihumans emailphone partial · 16
1000delacommune.info ↗ 200 1000 de la Commune est, Old Montreal / Vieux Montréal, QC en real-estate-buying-and-selling robotsllmsaihumans emailphone partial · 16
1000delacommunefr.info ↗ 200 1000 De La Commune E | Old Montreal Waterfront Condo | Vieux-Port en real-estate-buying-and-selling robotsllmsaihumans emailphone partial · 16
1000leestreet.com ↗ 200 1000 Lee Street, Milton, GA en houses robotsllmsaihumans emailphone partial · 16
100beats.org ↗ 200 100BEATS FOR YOUR HEADTOP musicX-Cart robotsllmsaihumans emailphone partial · 14
100brixmadeit.com ↗ 200 Buy Beats Online | Download Beats | Rap Beats For Sale | Instrumentals For Sale en audio-production robotsllmsaihumans emailphone partial · 14
100centennial.com ↗ 200 100 Centennial Court, Hinesville, GA United States~ en houses robotsllmsaihumans emailphone partial · 16
100handjobs.com ↗ 200 Sign up in one easy step, 100 Hand Jobs en adult-and-explicit-sexual-content robotsllmsaihumans emailphone partial · 14
100hayden.com ↗ 200 100 Hayden Street, Suite 1907, Toronto, ON en apartments robotsllmsaihumans emailphone partial · 16
100jili.art ↗ 200 100JILI Casino | Super Ace Live Casino&Slots -100JILI.CLUB casinos-and-gambling robotsllmsaihumans emailphone full · 18
100jili.cam ↗ 200 100JILI Casino | Super Ace Live Casino&Slots -100JILI.CLUB casinos-and-gambling robotsllmsaihumans emailphone full · 18
100jili.ph ↗ 200 100JILI Casino | Super Ace Live Casino&Slots -100JILI.CLUB casinos-and-gambling robotsllmsaihumans emailphone full · 18
100jiliph.vip ↗ 200 100JILI Casino | Super Ace Live Casino&Slots -100JILI.CLUB casinos-and-gambling robotsllmsaihumans emailphone full · 18
100limousines.com ↗ 200 Music | 100 LIMOUSINES en music robotsllmsaihumans emailphone partial · 10
100nbrackenbury.com ↗ 200 100 N Brackenbury Lane, Charlotte, NC en real-estate-buying-and-selling robotsllmsaihumans emailphone partial · 16
100picsquizanswers.com ↗ 200 100 Pics Quiz Answers: Packs, Levels & Walkthroughs en games-and-puzzles robotsllmsaihumans emailphone partial · 14
100seotips.com ↗ 200 富华优配|配资炒股网|股票配资平台|配资之家 zh stocks-and-bonds robotsllmsaihumans emailphone full · 20
100signals.com ↗ 200 100Signals: Demand generation for software dev agencies en marketing-and-advertising robotsllmsaihumans emailphone full · 19
100tallowood.com ↗ 200 100 Tallowood Drive, Medford, NJ United States~ en houses robotsllmsaihumans emailphone partial · 16
123-yahoo.com ↗ 200 Yahoo | Mail, Weather, Search, Politics, News, Finance, Sports & Videos en sports robotsllmsaihumans emailphone full · 15
123alexander.com ↗ 200 123 Alexander Ave, Montclair, NJ en houses robotsllmsaihumans emailphone partial · 16
123chapelave.com ↗ 200 123 S. Chapel Ave, Alhambra, CA en apartments robotsllmsaihumans emailphone partial · 16
123directmail.com ↗ 200 123DirectMail | by 2OGS LLC | Direct Mail & Mailing Services en marketing-and-advertising robotsllmsaihumans emailphone full · 16
123inventatuweb.com ↗ 200 Home Page en web-design-and-html robotsllmsaihumans emailphone partial · 14
123johnsonmanor.com ↗ 200 123 Johnson Manor St., Mooresville, NC en real-estate-buying-and-selling robotsllmsaihumans emailphone partial · 16
123pyt.org ↗ 200 Pennsylvania Youth Theatre - It all starts here. en theaterWordPress robotsllmsaihumans emailphone full · 20
123stitch.com ↗ 200 Cross Stitch Patterns, Cross Stitch Kits, Cross Stitch Fabric, Embroidery Floss, Embroidery Thread, Aida, Linen from 123Stitch.com United States~ en needlework robotsllmsaihumans emailphone partial · 5
1800officesolutions.com ↗ 200 1-800 Office Solutions — The Operating System for Your Office United States~ en business-i-tWordPress robotsllmsaihumans emailphone full · 19
18thstreet.org ↗ 200 Home | 18th Street Arts Center en fine-artWordPress robotsllmsaihumans emailphone full · 20
1a-finanzmarkt.com ↗ 200 1A-Finanzmarkt.de - Kredit & Versicherung vergleichen de personal-finance robotsllmsaihumans emailphone partial · 2
1a-finanzmarkt.net ↗ 200 1A-Finanzmarkt.de - Kredit & Versicherung vergleichen de personal-finance robotsllmsaihumans emailphone partial · 2
Showing the first 1,000 of 139,562 matches · page 1/20next ›
Analyzing…
live scan: category · tech · contacts · AI policy · links