Foreman, a self-hosted LLM gateway for cost aware model routing
Details
- External ID
- 48835063
- Source
- HN
- Company
- —
- Product
- Mantis, A self-hosted LLM gateway
- Website domain
- github.com
- Launched
- July 8, 2026
- Cohort
- —
- Upvotes
- 15
- Upvotes percentile
- 0.6475507765830346
- Tags
- —
- Fetched at
- Sept. 7, 2026, 9:26 p.m.
- Updated at
- Sept. 7, 2026, 9:26 p.m.
Enrichment
- Theme
- ML inference and model optimization
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI feature
- Project type
- Commercial product
- Normalized one-liner
- self-hosted llm gateway with cost routing
- Manually corrected
- False
Could you build this?
Yes A self-hosted LLM gateway for cost-aware model routing is a standard proxy server that inspects incoming requests, calculates token estimates, and forwards calls to configured LLM provider APIs.
Discussion
16 comments analyzed.
Competitors mentioned: Sakana Fugu, Foreman (provisioning/patching tool)
Concerns raised: Handling concurrent agent/subagent spawning and session management, Name collision with existing Foreman software tool, Linear agent session limitations
Feature requests: Display and save cost data on agent flow runs
Competitors
Other products that read as similar to this one — 579 launches clear the similarity bar, closest 8 shown.
Attention rank: #181 of 580 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 250 days after the earliest competitor.
- ClawRouter · hn · 2026-02-05 · 12 upvotes · similarity 0.70
- genpark-multi-model-cost-latency-router-skill · github · 2026-09-12 · 8 upvotes · similarity 0.68
- genpark-multi-model-cost-latency-router-skill · github · 2026-09-12 · 7 upvotes · similarity 0.68
- LLMRouter · hn · 2025-12-31 · 5 upvotes · similarity 0.67
- Kairo · hn · 2026-09-14 · 5 upvotes · similarity 0.64
- llm-gateway-comparison · github · 2026-09-17 · 59 upvotes · similarity 0.58
- A Highly Available Distributed Router for Global Realtime AI · hn · 2026-06-08 · 9 upvotes · similarity 0.56
- JevRouter · github · 2026-09-18 · 163 upvotes · similarity 0.56
Other launches for this product
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.