Data-Free Flow Self-Distillation for Few-Step Video Generation — open-sourced a validated implementation on MiniMax-H3 [P]

Reddit r/MachineLearning Models

Summary

HyperFlow is an open-source 8-step LoRA that uses data-free flow self-distillation to reduce video generation steps from 49 to 8 in MiniMax-H3, achieving significant speedup while maintaining quality.

Hi there, I'm Yuesong, a researcher at Video Rebirth. We open-sourced HyperFlow, an 8-step LoRA for MiniMax-H3. The core idea: data-free flow self-distillation. Diffusers' default sampler does 49 model forwards; we trained a LoRA so the model reproduces that trajectory in 8 steps. The base model is the only teacher — no external dataset, no human labels. Comparisons against base H3 (unedited, same prompts, same seeds) — https://videorebirth.com/lp/hyperflow What we measured: Camera control Temporal consistency Material/detail rendering Overall balance Speed: (same clip: fl2va, 124 frames, 1344×768; generation time only, not including startup and weight loading) ~60s on 4× H200 vs ~175s for the 49-step base (2.9×) ~130s on 1× H200 with official auto CPU offload vs ~395s (3.0×) Combined with Sol-Attn, FlashAttention, and VAE parallelism, it can be sped up by more than another 5×. On an 8-GPU B200 cluster, it reaches real-time speed (generation takes less time than the clip itself). Links: Code: https://github.com/Video-Rebirth/hyperflow Weights: https://huggingface.co/videorebirth/hyperflow Demo comparisons: https://videorebirth.com/lp/hyperflow This model is a derivative of MiniMax-H3 and is released under the MiniMax H3 Community License Agreement. Please read the license carefully, especially the territorial restrictions and the Acceptable Use Policy, before use. Known limitations: It's a few-step distillation of H3: please compare it against the base model on your own prompts (same seed) Prompt following, languages, biases and failure modes are the base model's Not a generic LoRA. It needs the HyperFlow loader, not a standard LoRA loader Open-source release supports 768p inference resolution The MiniMax H3 Community License excludes US, EU, UK, and South Korea (inherited from the base model's license terms) What use cases would you most want to try this on? Happy to dig into the technical details if anyone's curious about the self-distillation approach.
Original Article

Similar Articles

AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillation

Hugging Face Daily Papers

AnyFlow introduces a novel any-step video diffusion distillation framework that optimizes full ODE sampling trajectories through flow-map transition learning and backward simulation, achieving performance that matches or surpasses consistency-based counterparts while scaling with sampling step budgets.