Claude and ChatGPT need a datacenter. This runs on my phone
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
HN · launched Sep 1, 2026 · 18 upvotes (top 28%) · 0 views
Niche: llm routing and gateway tools · 143 launches, 5 in the last 7 days ▼ -62% · Explore this niche →
Category and tags
- Horizontal
- Model & infra
- Prosumer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 143 launches in llm routing and gateway tools →
Could you build this?
No Running local LLMs efficiently on mobile devices without internet requires deep expertise in low-level model quantization, Apple Metal / Qualcomm NPU hardware acceleration kernels (e.g. llama.cpp or MLX porting), and mobile memory optimization. It is far beyond the reach of vibe coding.
What it would actually take: The app requires compiling and optimizing C++ inference engines like llama.cpp or MLC-LLM for iOS/Android, linking against Metal Performance Shaders (MPS) or NNAPI/Hexagon DSPs. Models must be quantized to 2-4 bit formats (e.g., GGUF, AWQ) with strict memory bounds so the OS watchdog doesn't kill the app due to RAM limits. This requires specialized expertise in low-level ML systems engineering, hardware-accelerated computing, and mobile OS memory management.
Discussion
7 comments analyzed.
Competitors mentioned: PocketPal AI, Google AI Edge Gallery, MLC Chat
Concerns raised: Performance significantly slower than competitors (AI Edge, MLC, PocketPal), Exaggerated claims about running on 'almost any phone' - actual performance underwhelming, In-app performance indicator misleading ('run comfortably' claim doesn't match reality), Direct APK download from website lacks professional presentation, security concerns
Feature requests: Optional online lookup mode while keeping offline as default, Tool integration for models to perform various tasks via harness
Competitors
Other products that read as similar to this one : 262 launches clear the similarity bar, closest 8 shown.
Attention rank: #85 of 263 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 293 days after the earliest competitor.
- ChatGPT answers calls on a normal SIM. No Twilio, just a $6 ESP32 · hn · 2026-10-06 · 11 upvotes · similarity 0.53
- I got 50% of my traffic from ChatGPT instead of Google · hn · 2025-12-09 · 16 upvotes · similarity 0.49
- tunneldock · github · 2026-09-16 · 38 upvotes · similarity 0.49
- chatgpt-prism2api · github · 2026-09-24 · 15 upvotes · similarity 0.47
- ChatGPT-Plus-Pro- · github · 2026-10-28 · 30 upvotes · similarity 0.45
- A USB-C LTE modem that gives my computer a phone line · hn · 2026-10-31 · 61 upvotes · similarity 0.45
- Claude-codex-proxy · hn · 2026-04-19 · 7 upvotes · similarity 0.45
- GPTplusSub · github · 2026-10-24 · 40 upvotes · similarity 0.45
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.