I wrote a 1-bit WebGPU runtime to run a 1.7B LLM in the browser
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
HN · launched Jul 7, 2026 · 5 upvotes (top 89%) · 0 views
Niche: llm inference and deployment tools · 188 launches, 6 in the last 7 days · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Developer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 188 launches in llm inference and deployment tools →
Could you build this?
No Writing a custom 1-bit quantized inference runtime in WebGPU shader language (WGSL) to execute a 1.7B parameter language model in the browser requires cutting-edge GPU compute and ML systems expertise.
What it would actually take: This requires implementing custom WGSL compute shaders for 1-bit / sub-byte matrix multiplication (such as BitNet b1.58 or ternary/binary GEMM kernels), managing WebGPU memory buffers, and implementing a complete transformer execution pipeline (KV cache, RMSNorm, RoPE, attention). The core difficulty lies in optimizing memory bandwidth and SIMD/subgroup operations within browser GPU constraints to achieve acceptable tokens-per-second inference speeds.
Discussion
2 comments analyzed.
Concerns raised: 300MB initial download may be too large for quick support Q&A use case, Download time delay before model is available for questions
Feature requests: Hosted fallback Q&A while model downloads, Cache model locally after initial download to avoid re-downloading
Competitors
Other products that read as similar to this one : 1038 launches clear the similarity bar, closest 8 shown.
Attention rank: #938 of 1039 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 250 days after the earliest competitor.
- Running Win32/DirectX games in the browser via x86 emulation and WebGPU · hn · 2026-07-14 · 5 upvotes · similarity 0.58
- Open-source calculator for "will my GPU run this LLM?" · hn · 2026-08-24 · 5 upvotes · similarity 0.57
- INXM // local` OSS for using LLM as compiler and not as runtime · hn · 2026-08-19 · 5 upvotes · similarity 0.56
- Nanbeige 4.1-3B running in the browser via WebGPU · hn · 2026-02-19 · 6 upvotes · similarity 0.54
- I just released v7 Javalin, a JVM web framework · hn · 2026-02-24 · 6 upvotes · similarity 0.50
- Long term Memory and 50M token window for LLM · hn · 2026-10-09 · 6 upvotes · similarity 0.50
- framefields · github · 2026-10-02 · 251 upvotes · similarity 0.49
- The Simpsons Hit and Run Running in the Browser (WASM/WebGL) · hn · 2026-04-15 · 5 upvotes · similarity 0.49
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.