Turn wire protocols into structured statements LLMs can understand
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
Hi HN, we built an extension to Envoy proxy that parses and sends contents of requests to an LLM at runtime.We do that by adding a deterministic SQL parser, gGRPC payload inspection and LLM analysis of the payload before upstream call.Users are proxying headless agents traffic with it so that sec teams can have their prompts blocking harmful actions via network traffic before it leaves the agent.When you tell the LLM analyzing the traffic to block writes, it will spot it across the different protocols by looking at the structured payload we build from parsing the binary protocol.It runs as a UDS upstream, and we're exploring bundling it inside envoy to remove the UDS hop.Envoy is incredible, but it has limited support for anything outside http. Basic database query parsing, little policy enforcement on request contents, most of the stuff happens on HTTP and gRPC headers or metadata.Would love to hear any feedback: https://github.com/hoophq/hoop/tree/main/sidecar
HN · launched Sep 10, 2026 · 6 upvotes (top 67%) · 0 views
Niche: llm routing and gateway tools · 143 launches, 5 in the last 7 days ▼ -62% · Explore this niche →
Category and tags
- Horizontal
- Data infrastructure
- Developer
- AI-native
- Commercial product
More like this: all 143 launches in llm routing and gateway tools →
Could you build this?
Partial Writing standard LLM prompts is straightforward, but extending Envoy proxy with custom C++/Wasm filters for wire-protocol parsing and inline gRPC/SQL traffic interception requires specialized systems programming.
What it would actually take: A production version requires developing an Envoy C++ or WebAssembly (Wasm) HTTP/TCP filter that intercepts in-flight payloads without killing proxy latency. The filter must deserialize gRPC/Protobuf streams or parse raw SQL byte streams deterministically, forward structured payloads to an asynchronous LLM moderation or analysis queue, and enforce security policies (blocking or rewriting). This demands expertise in low-level networking, Envoy's internal event loop, and protocol deserialization.
Discussion
No comments on this launch.
Competitors
Other products that read as similar to this one : 237 launches clear the similarity bar, closest 8 shown.
Attention rank: #177 of 238 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 316 days after the earliest competitor.
- Castra · hn · 2026-04-01 · 8 upvotes · similarity 0.50
- I built a smart proxy so your coding agent can run loose · hn · 2026-07-14 · 14 upvotes · similarity 0.45
- Netfence · hn · 2026-01-25 · 58 upvotes · similarity 0.45
- Log every LLM call with tokens, cost, latency, and time to first token · hn · 2026-11-11 · 10 upvotes · similarity 0.44
- LavinMQ, an open-source message broker written in Crystal · hn · 2026-04-28 · 16 upvotes · similarity 0.43
- Browser Harness · hn · 2026-04-24 · 134 upvotes · similarity 0.43
- CodeRLM · hn · 2026-02-11 · 81 upvotes · similarity 0.43
- Rayline routes Claude Code subagents to on-device and cheaper models · hn · 2026-06-08 · 11 upvotes · similarity 0.43
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.