pega-omni
OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.
Details
- External ID
- 1383553695
- Source
- GITHUB
- Company
- —
- Product
- pega-omni
- Website domain
- github.com
- Launched
- Sept. 23, 2026
- Cohort
- —
- Upvotes
- 27
- Upvotes percentile
- 0.6958109146810146
- Tags
- cuda, full-duplex, gpt-live, inference-server, llm-serving, moshi, openai-api, personaplex, qwen3-tts, rust, speech-to-speech, text-to-speech, tts, voice-ai
- Fetched at
- Sept. 27, 2026, 5:02 p.m.
- Updated at
- Sept. 27, 2026, 5:02 p.m.
Enrichment
- Theme
- voice AI agents and infrastructure
- Vertical
- Horizontal
- Function
- Model & infra
- Audience
- Developer
- AI stance
- AI-native
- Project type
- Hobby / open-source project
- Normalized one-liner
- rust-based openai-compatible speech serving server
- Manually corrected
- False
Could you build this?
Partial The OpenAI-compatible HTTP API in Rust can be built with AI, but high-throughput, low-latency speech serving (STT/TTS model quantization, audio streaming, and GPU acceleration) requires systems engineering expertise.
What it would actually take: Requires an async Rust web server (Axum/Actix-web) integrated with native C/C++ inference backends (like ONNX Runtime, libtorch, or candle) for speech models like Whisper and MeloTTS/Kokoro. The challenging aspect is implementing lock-free audio buffer streaming via WebSockets/SSE, real-time chunked audio encoding/decoding, and managing GPU tensor concurrency.
Competitors
Other products that read as similar to this one — 1082 launches clear the similarity bar, closest 8 shown.
Attention rank: #338 of 1083 (itself plus its competitors, highest first — normalized so YC and Product Hunt are compared fairly).
Launched 328 days after the earliest competitor.
- Speko: OpenRouter for Voice · yc · 2026-07-29 · 14 upvotes · similarity 0.67
- jev-mac-voice · github · 2026-09-19 · 20 upvotes · similarity 0.63
- Docker-whisper: Self-hosted Whisper speech-to-text server (OpenAI API) · hn · 2026-04-11 · 6 upvotes · similarity 0.63
- Speko · ph · 2026-08-27 · 266 upvotes · similarity 0.62
- voxweave · github · 2026-09-09 · 32 upvotes · similarity 0.61
- awesome-tts-architectures · github · 2026-09-13 · 15 upvotes · similarity 0.60
- oido · github · 2026-09-30 · 24 upvotes · similarity 0.59
- OmniVChat · github · 2026-09-18 · 34 upvotes · similarity 0.59
Other launches for this product
- No other launches for this product.
Same idea, different domain
Nobody's really built a model & infra tool for Fintech yet.