Samosa Chat
Run Qwen3.6-35B-A3B Locally on a 16 GB Mac
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
HN · launched Jul 15, 2026 · 6 upvotes (top 71%) · 0 views
Niche: llm evaluation and deployment tools · 77 launches, 0 in the last 7 days · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Prosumer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 77 launches in llm evaluation and deployment tools →
Could you build this?
Yes Samosa Chat is a desktop or terminal chat interface wrapping existing local inference engines (such as llama.cpp or MLX) with quantized weights for Apple Silicon, which requires standard UI and CLI glue code.
Discussion
9 comments analyzed.
Competitors mentioned: llama.cpp, vllm
Concerns raised: Mac overheating with local models, Token throughput speed (7 tokens/sec considered slow), Memory usage scaling (jumped from 22GB to 27GB)
Feature requests: Run multiple local models continuously on Mac, Integration with Chat application
Competitors
Other products that read as similar to this one : 707 launches clear the similarity bar, closest 8 shown.
Attention rank: #520 of 708 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 251 days after the earliest competitor.
- Run an 80B Qwen in 4.3 GB of RAM on a Mac, and a 35B on an iPhone · hn · 2026-08-03 · 312 upvotes · similarity 0.64
- Qwen3.6-35B-A3B on a 16 GB M1 Pro with SSD-streamed MoE · hn · 2026-07-17 · 24 upvotes · similarity 0.63
- qwen3.6-35b-a3b-144T-S · github · 2026-09-20 · 15 upvotes · similarity 0.58
- Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s · hn · 2026-09-01 · 240 upvotes · similarity 0.56
- qwen38-flash-next-w4a16-cmp170hx · github · 2026-09-16 · 10 upvotes · similarity 0.50
- I fine-tuned Qwen 3.5 (0.8B–4B) on a Mac for text-to-SQL · hn · 2026-03-05 · 7 upvotes · similarity 0.50
- Tesla_OS_On_QEMU · github · 2026-09-22 · 69 upvotes · similarity 0.49
- brainless · github · 2026-10-13 · 27 upvotes · similarity 0.49
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.