Rapid-MLX
Run local LLMs on Mac, 2-3x faster than alternatives
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
HN · launched Apr 18, 2026 · 9 upvotes (top 45%) · 0 views
Niche: llm inference engines · 133 launches, 4 in the last 7 days ▼ -33% · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Developer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 133 launches in llm inference engines →
Could you build this?
No Beating existing optimized inference engines (like Apple MLX or llama.cpp) by 2-3x requires expert-level Metal Shading Language (MSL) kernel programming, GPU memory layout optimization, and hardware-level quantization schemes.
What it would actually take: The stack requires Apple Silicon MLX, C++, and custom Metal compute kernels. The hard parts involve low-latency attention mechanisms (e.g., FlashAttention customized for Unified Memory Architecture), kernel fusion for matrix multiplication and activations, and fine-tuned KV-cache paging. This requires deep GPU systems programming expertise and low-level Apple silicon architecture tuning.
Discussion
4 comments analyzed.
Competitors mentioned: Ollama, omlx, fast-mlx, existing inference servers
Concerns raised: Most models fail at structured tool calling, Existing servers are slow on MLX, Non-Qwen models have inconsistent tool calling (40-100% depending on framework)
Feature requests: Benchmarks against omlx and fast-mlx, Support for other open source projects beyond coding
Competitors
Other products that read as similar to this one : 1621 launches clear the similarity bar, closest 8 shown.
Attention rank: #736 of 1622 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 171 days after the earliest competitor.
- local-llms-with-mlx · github · 2026-09-13 · 18 upvotes · similarity 0.82
- Local AI · hn · 2026-02-05 · 5 upvotes · similarity 0.61
- Llmspeed · hn · 2026-10-17 · 329 upvotes · similarity 0.61
- PocketOrca-LLM · github · 2026-09-14 · 8 upvotes · similarity 0.60
- Self-host open-source LLMs on AWS with scale-to-zero · hn · 2026-09-09 · 7 upvotes · similarity 0.57
- INXM // local` OSS for using LLM as compiler and not as runtime · hn · 2026-08-19 · 5 upvotes · similarity 0.57
- Wafer Pass: flat-rate access to the fastest open-source LLMs · yc · 2026-04-30 · 7 upvotes · similarity 0.56
- Local automation runner with built-in LLM steps · hn · 2026-06-20 · 5 upvotes · similarity 0.56
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.