open_rknpu2_lm_infer
Fully open-source, high-performance LLM inference engine for the RK3588 NPU
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Visit website ↗ Source listing ↗
GITHUB · launched Oct 14, 2026 · 13 upvotes (top 78%)
- Horizontal
- Model & infra
- Developer
- AI-native
- Hobby / open-source project
Similar launches
See all 2931 similar launches →Could you build this?
No Running LLM inference on the RK3588 NPU requires low-level kernel and driver work, model quantization and conversion for a proprietary NPU format, and performance tuning. Vibe coding cannot cover that without hardware-specific expertise.
What it would actually take: A real engine needs the RKNPU driver interface and its operator library, or reverse engineering of the NPU's instruction set to write custom kernels. It also needs quantization-aware model conversion (for example from GGUF to the NPU format) and memory management across the SoC's NPU and CPU. This requires embedded systems, NPU architecture, and LLM inference optimization expertise, plus the RK3588 hardware for testing.
Competitors
Other products that read as similar to this one : 2931 launches clear the similarity bar, closest 8 shown.
Attention rank: #2168 of 2932 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 350 days after the earliest competitor.
- Open-source AMDGCN kernels for optimizing LLM inference · hn · 2026-08-25 · 5 upvotes · similarity 0.80
- Tiny-vLLM · hn · 2026-05-29 · 205 upvotes · similarity 0.79
- zero2vllm · github · 2026-10-12 · 14 upvotes · similarity 0.78
- Goku · hn · 2026-07-15 · 9 upvotes · similarity 0.77
- superfluid · github · 2026-10-08 · 14 upvotes · similarity 0.71
- strixite · github · 2026-10-04 · 11 upvotes · similarity 0.71
- Free Inference Engineer and Model Training Roadmap · hn · 2026-08-24 · 16 upvotes · similarity 0.69
- ml-rsi-inference-bench · github · 2026-10-16 · 105 upvotes · similarity 0.68
Other launches for this product
- No other launches for this product.
More details
- External ID
- 1419458453
- Company
- n/a
- Product
- open_rknpu2_lm_infer
- Website domain
- github.com
- Cohort
- n/a
- Upvotes percentile
- 0.22
- All tags
- n/a
- AI summary
- llm inference engine for rk3588 npu chips
- Manually corrected
- No