laya-mps
Run Jev-style typed decisions locally on your Mac with low RAM usage and fast responses
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
GITHUB · launched Sep 21, 2026 · 22 upvotes (top 36%) · 0 views
Niche: machine learning inference engines · 108 launches, 8 in the last 7 days ▼ -27% · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Developer
- AI-native
- Commercial product
- ai
- apple-silicon
- decision-model
- jev
- laya
- local-ai
- +3 more
Visit website ↗ Source listing ↗
More like this: all 108 launches in machine learning inference engines →
Could you build this?
Partial Creating a local runner with an API wrapper is vibe-codeable, but running low-RAM, high-performance typed decision models locally on Apple Silicon requires Metal/MPS optimization and ML systems tuning.
What it would actually take: The project requires an Apple Silicon execution runtime leveraging Metal Performance Shaders (MPS) or MLX/llama.cpp-style quantization and memory-mapped model weights. The tricky part is optimizing memory footprint while maintaining fast inference latency and strictly enforcing schema/typed outputs via grammars (e.g., GBNF or outlines). It requires engineers familiar with local LLM runtimes, Metal compute kernels, and structured generation engines.
Competitors
Other products that read as similar to this one : 2909 launches clear the similarity bar, closest 8 shown.
Attention rank: #1075 of 2910 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 325 days after the earliest competitor.
- Gutsy · hn · 2026-10-06 · 7 upvotes · similarity 0.74
- keel · github · 2026-09-22 · 270 upvotes · similarity 0.67
- awesome-jev · github · 2026-09-18 · 75 upvotes · similarity 0.65
- laya-coreml · github · 2026-09-19 · 1381 upvotes · similarity 0.64
- laya-ort · github · 2026-10-09 · 27 upvotes · similarity 0.64
- rizzo-flow · github · 2026-09-21 · 455 upvotes · similarity 0.64
- awesome-jev-typesafe · github · 2026-09-18 · 129 upvotes · similarity 0.63
- jevcache · github · 2026-09-18 · 71 upvotes · similarity 0.61
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.