ninfer-ternary-bonsai-ada
Ternary (2.125 bit/weight) Bonsai 2 27B on the NINFER engine — Ada sm_89, Linux. Derivative work of Neroued/ninfer; see README.
Details
- External ID
- 1378419248
- Source
- GITHUB
- Company
- —
- Product
- ninfer-ternary-bonsai-ada
- Website domain
- github.com
- Launched
- Sept. 20, 2026
- Cohort
- —
- Upvotes
- 23
- Upvotes percentile
- 0.6508455034588778
- Tags
- —
- Fetched at
- Sept. 24, 2026, 5:02 p.m.
- Updated at
- Sept. 24, 2026, 5:02 p.m.
Enrichment
- Theme
- hardware hacking and maker projects
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI-native
- Project type
- Hobby / open-source project
- Normalized one-liner
- quantized model runner for bonsai 2 27b on ada gpus
- Manually corrected
- False
Could you build this?
No Developing a ternary (2.125-bit) LLM inference engine optimized for Ada Lovelace (sm_89) architectures requires deep low-level CUDA and hardware microarchitecture engineering.
What it would actually take: Requires writing custom CUDA and PTX kernels targeting Ada Lovelace tensor cores and memory hierarchies to perform ultra-low-bit packed GEMM operations with dynamic activation quantization. Needs deep expertise in compiler technology, GPU cache line optimization, and numerical precision mapping for 27B parameter models.
Competitors
Other products that read as similar to this one — 23 launches clear the similarity bar, closest 8 shown.
Attention rank: #8 of 24 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 173 days after the earliest competitor.
- Bonsai-27B-NInfer · github · 2026-09-24 · 10 upvotes · similarity 0.60
- Bonsai 1.7B ternary model at 442T/s on M4 Max · hn · 2026-05-04 · 13 upvotes · similarity 0.54
- bonsai2-small-gpu · github · 2026-09-19 · 54 upvotes · similarity 0.51
- lmstudio-prism-bonsai · github · 2026-09-21 · 9 upvotes · similarity 0.49
- Pestle-27B-Ternary · hn · 2026-08-14 · 9 upvotes · similarity 0.47
- OrcaBonsai-27B-Uncensored · github · 2026-09-18 · 526 upvotes · similarity 0.41
- ninfer-v100 · github · 2026-09-15 · 19 upvotes · similarity 0.40
- 1-Bit Bonsai, the First Commercially Viable 1-Bit LLMs · hn · 2026-03-31 · 430 upvotes · similarity 0.37
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.