Shoehorn
Quantize any model down to run on your machine
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so far. https://github.com/notactuallytreyanastasio/shoehorn
HN · launched Aug 18, 2026 · 97 upvotes (top 7%) · 0 views
Niche: llm evaluation and deployment tools · 78 launches, 1 in the last 7 days · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Developer
- AI-native
- Commercial product
Visit website ↗ Source listing ↗
More like this: all 78 launches in llm evaluation and deployment tools →
Could you build this?
Yes Shoehorn acts as a GUI wrapper around established open-source quantization toolchains like `llama.cpp` (GGUF quantization) and Hugging Face downloads.
Discussion
16 comments analyzed.
Competitors mentioned: LLMFit - similar tool for checking what models can run on hardware, Shoehorn - alternative for model-to-hardware matching, colibri - related project for model optimization, airllm - similar approach to model quantization
Concerns raised: Extreme model divergence when distilling/quantizing large models, Post-training quantization (PTQ) is resource-intensive and may not work on all machines, Insufficient memory errors despite tool's recommendations, Questionable claims about fitting very large models (e.g., Fable 5) into 4B parameters
Feature requests: Support for 48GB Mac Studio M5 Max configurations, Handle quantizing larger models like Kimi K3 with 8GB budget constraint, Integration or compatibility with colibri project
Competitors
Other products that read as similar to this one : 36 launches clear the similarity bar, closest 8 shown.
Attention rank: #4 of 37 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 209 days after the earliest competitor.
- Shoehorn, a library to quantize an LLM to fit your Mac's VRAM · hn · 2026-08-14 · 6 upvotes · similarity 0.49
- RunLLMLocal · ph · 2026-11-01 · 1 upvotes · similarity 0.40
- I finetuned 1.5B Qwen to near GPT-4o level bash generation perf · hn · 2026-10-05 · 6 upvotes · similarity 0.36
- A language model that lives in a boot sector · hn · 2026-10-31 · 107 upvotes · similarity 0.35
- codex-local · github · 2026-09-19 · 9 upvotes · similarity 0.35
- 1VM · ph · 2026-09-23 · 1 upvotes · similarity 0.35
- macOS native DAW with Git branching model · hn · 2026-01-21 · 26 upvotes · similarity 0.35
- I built a visual node system for CI/CD that supports GitHub Actions · hn · 2026-02-10 · 18 upvotes · similarity 0.34
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.