llmaker
Selfhost LLM stacks. Run whole fleets from your terminal
Details
- External ID
- 1245546
- Source
- PH
- Company
- —
- Product
- llmaker
- Website domain
- producthunt.com
- Launched
- Sept. 10, 2026
- Cohort
- —
- Upvotes
- 3
- Upvotes percentile
- 0.8905013897797733
- Tags
- Open Source, Developer Tools, Artificial Intelligence, GitHub
- Fetched at
- Sept. 12, 2026, 1:01 a.m.
- Updated at
- Sept. 12, 2026, 1:01 a.m.
Description
llmaker is an open source platform for running the complete modern LLM stack on your own infrastructure. Large language models, vector databases, embeddings, caching, observability and a builtin retrieval & agent layer. All provisioned, networked and production shaped from a single command. Build private retrieval augmented chatbots, FAQ assistants and recommendation engines locally. No third-party API keys. No data leaving your machine.
Enrichment
- Theme
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI feature
- Project type
- Commercial product
- Normalized one-liner
- self-hosted llm management tool
- Manually corrected
- False
Could you build this?
No Building an infrastructure orchestrator that provisions and networks complete local/hybrid LLM clusters, vector databases, and GPU drivers from a single terminal command requires deep systems, virtualization, and DevOps engineering.
What it would actually take: The architecture involves writing a CLI and daemon (likely in Go or Rust) that interfaces with container runtimes (Docker/containerd), GPU device plugins (NVIDIA CUDA toolkit/Triton), and orchestration engines (Kubernetes or lightweight alternatives like Nomad). The hard engineering lies in automated GPU resource allocation, hardware-accelerated networking, dynamic model memory mapping (vLLM/Ollama engines), and resilient multi-container networking. This requires senior systems/cloud infrastructure engineers with specialized GPU/MLOps expertise.
Competitors
Other products that read as similar to this one — 86 launches clear the similarity bar, closest 8 shown.
Attention rank: #10 of 87 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 311 days after the earliest competitor.
- Llmpm · hn · 2026-03-09 · 6 upvotes · similarity 0.52
- Self hosting a modern LLM stack · hn · 2026-06-29 · 5 upvotes · similarity 0.47
- Run LLMs in Docker for any language without prebuilding containers · hn · 2026-01-14 · 26 upvotes · similarity 0.45
- LLM Ⅰ beta · ph · 2026-09-15 · 1 upvotes · similarity 0.44
- Bash4LLM+ · hn · 2026-06-28 · 60 upvotes · similarity 0.43
- ManageLM · ph · 2026-09-18 · 1 upvotes · similarity 0.43
- Mantis, A self-hosted LLM gateway · hn · 2026-06-26 · 5 upvotes · similarity 0.42
- Recursi · hn · 2026-06-04 · 6 upvotes · similarity 0.42
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.