Got VACE working in real-time
30fps on a 5090
Get picks like this daily. Today's launch numbers, the top launches, AI and tech news, and a daily opportunity pick, straight to your inbox.
Want to reach these readers? Sponsor an issue.
I adapted VACE to work with real-time autoregressive video generation.Here's what it can do right now in real time:- Depth, pose, optical flow, scribble, edge maps — all the v2v control stuff - First frame animation / last frame lead-in / keyframe interpolation - Inpainting with static or dynamic masks - Stacking stuff together (e.g. depth + LoRA, inpainting + reference images) - Reference-to-video is in there too but honestly quality isn't great yet compared to batchGetting ~20 fps for most control modes on a 5090 at 368x640 with the 1.3B models. Image-to-video hits ~28 fps. Works with 14b models as well, but doesnt fit on 5090 with VACE.This is all part of Daydream Scope (https://github.com/daydreamlive/scope), which is an open source tool for running real-time interactive video generation pipelines. The demo was created in scope, and is a combination of Longlive, VACE+Scribble, Custom LoRA.There's also a very early WIP ComfyUI node pack wrapping scope: https://github.com/daydreamlive/ComfyUI-Daydream-ScopeCurious what people think.
HN · launched Feb 12, 2026 · 10 upvotes (top 47%) · 0 views
Niche: ai video generation tools · 760 launches, 45 in the last 7 days ▼ -46% · Explore this niche →
Category and tags
- Horizontal
- Content generation
- Developer
- AI-native
- Hobby / open-source project
Visit website ↗ Source listing ↗
More like this: all 760 launches in ai video generation tools →
Could you build this?
No Achieving 30fps real-time autoregressive video generation and video-to-video conditioning on consumer hardware requires custom CUDA kernels, tensor optimization, and deep generative video modeling expertise.
What it would actually take: A real version requires adapting diffusion/autoregressive video architectures (like VACE) with TensorRT, FlashAttention, and custom CUDA C++ kernels to maximize GPU memory bandwidth on RTX 50-series cards. Techniques like speculative decoding, latent cache reuse, and pipelined frame conditioning are necessary. This demands senior GPU systems researchers with deep knowledge of PyTorch internals and high-performance graphics compute.
Discussion
No comments on this launch.
Competitors
Other products that read as similar to this one : 287 launches clear the similarity bar, closest 8 shown.
Attention rank: #135 of 288 (itself plus its competitors, highest first, normalized so YC and Product Hunt are compared fairly).
Launched 103 days after the earliest competitor.
- Virtual time engine to record HTML to 60fps MP4, no drops · hn · 2026-07-26 · 5 upvotes · similarity 0.47
- ComfyUI-Qwen-VAE-Triton · github · 2026-09-13 · 7 upvotes · similarity 0.46
- Filmimic · github · 2026-10-22 · 30 upvotes · similarity 0.45
- lingbot-world-v2-realtime · github · 2026-09-16 · 14 upvotes · similarity 0.43
- 3d-video-converter · github · 2026-11-10 · 102 upvotes · similarity 0.42
- ComfyUI-Tessera · github · 2026-10-30 · 92 upvotes · similarity 0.42
- Crow-DLSS5-Video-Image-Converte · github · 2026-09-11 · 7 upvotes · similarity 0.41
- LemonSlice · hn · 2026-01-27 · 133 upvotes · similarity 0.41
The niche, labels, vibe code rating and competitor comparison on this page are analysis by Nicheloom. If you use them, please credit nicheloom.com. How you may use our data.