splash
A local inference engine for Apple silicon, built around the model.
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
GITHUB · launched Sep 18, 2026 · 610 upvotes (top 1%) · 1 view
Niche: machine learning inference engines · 108 launches, 8 in the last 7 days ▼ -27% · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Developer
- AI-native
- Hobby / open-source project
- apple-silicon
- coding-agents
- llm-inference
- macos
- metal
- speculative-decoding
Visit website ↗ Source listing ↗
More like this: all 108 launches in machine learning inference engines →
Could you build this?
No Developing a custom Apple Silicon LLM inference engine with shape-specific fused Metal/MPS kernels, speculative decoding, and custom memory layout requires elite systems and GPU programming expertise.
What it would actually take: Built using Metal Shading Language (MSL), C++/Swift, and Apple's Unified Memory APIs with custom GPU memory allocators and fused transformer kernels. The hard part is hand-tuning matrix multiplication and attention kernels to rival or beat Apple's MLX and llama.cpp while implementing specialized speculative draft models for specific architectures.
Competitors
Other products that read as similar to this one : 5084 launches clear the similarity bar, closest 8 shown.
Attention rank: #61 of 5085 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 324 days after the earliest competitor.
- coachwhip · github · 2026-10-01 · 28 upvotes · similarity 0.78
- my-little-trie-forge · github · 2026-10-02 · 11 upvotes · similarity 0.78
- SplashMonitor · github · 2026-09-20 · 16 upvotes · similarity 0.76
- OpenRelay: The Inference Delivery Network · yc · 2026-08-07 · 13 upvotes · similarity 0.75
- coreglass · github · 2026-10-02 · 12 upvotes · similarity 0.74
- lithos-metal · github · 2026-10-05 · 129 upvotes · similarity 0.73
- IronMule · ph · 2026-09-17 · 1 upvotes · similarity 0.72
- kapitsa · github · 2026-10-16 · 155 upvotes · similarity 0.71
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.