SolarRenderer: Few-Step Generative Reference Rendering

Hugging Face Daily Papers Papers

Summary

SolarRenderer 将任意引擎的无纹理结构通道结合参考首帧,生成风格化完整视频,基于 MiniMax-H3 构建,通过控制 LoRA 与少步蒸馏 LoRA 实现实时逐帧结构一致的渲染,无需按游戏训练。

Game engines and coding agents can specify the layout, motion, and camera of a scene, yet turning such coarse structure into realistic video requires a renderer that follows the structure and completes the appearance it leaves open. Existing renderers are tied to the representation of one engine, need tens of denoising steps or a costly distillation of their own, and learn from conditions that are not aligned with their target videos. We present SolarRenderer, a structure-conditioned video renderer that adapts a frozen MiniMax-H3 33B backbone with two lightweight LoRAs. Structural videos enter the native reference pathway of the backbone at the positions of the frames they describe, without a type identifier and described only in plain text, so that a single control LoRA follows arbitrary structural representations. Starting from a pretrained four-step LoRA, structure-guided distribution matching renders in four steps, 12.3 times faster than 50-step sampling, while preserving the learned control. A block-causal variant extends the same design to streaming and renders 768p video in real time. To train the model, we build a frame-aligned corpus of 136K clips from game engines, simulators, and YouTube videos. Experiments on an in-distribution test set and a generalization benchmark of 16 structural representations show that SolarRenderer achieves state-of-the-art results across both, and generalizes to 11 unseen representations, including pose skeletons, drawings, and point clouds.
Original Article
View Cached Full Text

Cached at: 10/21/26, 07:03 AM

Paper page - SolarRenderer: Few-Step Generative Reference Rendering

Source: https://huggingface.co/papers/2610.28630 SolarRendererturns any engine’s untextured structure pass into a finished, styled video, guided by a reference first frame. The model is built on MiniMax-H3, with a control LoRA and a few-step distilled LoRA.

🎯**Precise structure.**The output follows the input’s geometry, motion and timing frame by frame. Every object stays where the engine put it, and the render keeps time with the game. On our held-out benchmark it ranks first on structure (Elo 1313 against nine other methods).

♾️**Endlessly general.**It takes any game, character or scene: Blender, three.js browser games, game engines, even a phone filming a screen. It renders in whatever look the first frame sets, with no per-game training.

⚡**Real-time and endless.**The block-causal student renders 4 steps per chunk. It produces a 17-frame chunk every 0.70 s at 24 fps, about 1.1 s behind its input. With a KV cache it keeps going as long as the input does. Pick up the controller and play.

📄 Paper:https://arxiv.org/abs/2610.28630 🌐 Project page (live demos):https://enderfga.cn/SolarRenderer/ 💻 Code:https://github.com/Enderfga/SolarRenderer 🤗 Weights · Data · Benchmark:https://huggingface.co/collections/Enderfga/solarrenderer

Similar Articles

Generative World Renderer at the Speed of Play

Hugging Face Daily Papers

This paper introduces AlayaRenderer-Flash, a real-time generative world renderer that accelerates rendering from 0.56 FPS to 31.54 FPS using a few-step autoregressive streaming model and lightweight distilled codecs, enabling interactive play with a physics engine.

@lemomo_ai: https://x.com/lemomo_ai/status/2103823847632060854

X AI KOLs Timeline

This article introduces an open-source project called lemo-opuscar, which uses Claude Opus 5.5 to render videos frame-by-frame via code, add soundtracks, and mix, creating 39 different video styles without relying on traditional video generation models.

Matrix-Game 4.0: Harnessing Video Models for Real-Time Playable Game Worlds

Hugging Face Daily Papers

Matrix-Game 4.0 将游戏逻辑与视觉合成分离,通过可执行引擎与自回归视频渲染器实现低延迟的实时可玩游戏世界,在单张 RTX5090 上达到 480p、60 FPS 及 112ms 按键到显示延迟,并开源代码、模型权重与低多边形游戏资产。