Weir
Semantic caching and model routing for RAG
Get picks like this daily. The day's top launches, AI/tech news, and a weekly opportunity spotlight — straight to your inbox.
This is 1 of 107 launches in llm routing and gateway tools — see how it stacks up on momentum and crowding →
81 other launches read as similar to this one →
Details
- External ID
- 1275074
- Source
- PH
- Company
- —
- Product
- Weir
- Website domain
- producthunt.com
- Launched
- Oct. 10, 2026
- Cohort
- —
- Upvotes
- 2
- Upvotes percentile
- 0.76
- Tags
- Open Source, Developer Tools, Artificial Intelligence, GitHub
Description
Weir is an open-source gateway for RAG that combines semantic caching, cost-aware model routing, and per-request cost and latency accounting. Includes a runnable demo, evaluation suite, and load tests.
Enrichment
- Niche
- llm routing and gateway tools
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI-native
- Project type
- Commercial product
- Normalized one-liner
- semantic caching and model routing for rag
- Manually corrected
- False
Could you build this?
Yes Building an API gateway with semantic caching (using vector similarity search via Qdrant/Milvus/Redis) and dynamic model routing based on rules and cost metrics is a well-understood developer tool pattern easily scaffolded with AI.
Competitors
Other products that read as similar to this one — 81 launches clear the similarity bar, closest 8 shown.
Attention rank: #15 of 82 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 344 days after the earliest competitor.
- Open-source model routing for coding agents at Astra-level performance · hn · 2026-09-30 · 119 upvotes · similarity 0.44
- gatekv · github · 2026-09-30 · 11 upvotes · similarity 0.43
- knowforge-metrics-rag · github · 2026-09-10 · 12 upvotes · similarity 0.42
- RAGless · hn · 2026-08-14 · 6 upvotes · similarity 0.41
- genpark-adaptive-retrieval-router-skill · github · 2026-09-29 · 7 upvotes · similarity 0.40
- Terraform RAG · hn · 2026-06-03 · 5 upvotes · similarity 0.40
- portkey-gateway · github · 2026-10-04 · 29 upvotes · similarity 0.40
- jev-rag-benchmark · github · 2026-09-19 · 14 upvotes · similarity 0.39
Other launches for this product
- No other launches for this product.