Generative World Renderer at the Speed of Play

Hugging Face Daily Papers Papers
generative-rendering world-model real-time physics-engine latent-diffusion autoregressive-streaming

Summary

This paper introduces AlayaRenderer-Flash, a real-time generative world renderer that accelerates rendering from 0.56 FPS to 31.54 FPS using a few-step autoregressive streaming model and lightweight distilled codecs, enabling interactive play with a physics engine.

Generative world renderer AlayaRenderer receives structured world states exported from physics engines and synthesizes RGB frames. Unlike models that generate frames from text/control-hints prompts, AlayaRenderer preserves scene structure without altering the underlying world dynamics. This demonstrates an alternative path toward interactive world modeling and user-controllable play. However, the original AlayaRenderer is too computationally expensive for real-time deployment. This technical report introduces AlayaRenderer-Flash, a real-time-oriented generative forward world renderer that pushes AlayaRenderer from 0.56 FPS to 31.54 FPS, reaching the speed of play. AlayaRenderer-Flash reformulates the original renderer as a few-step autoregressive streaming model and introduces lightweight distilled codecs for efficient latent encoding and frame reconstruction. It retains the teacher model's G-buffer and text-prompt interfaces while enabling continuous rendering over input streams of unbounded length. We evaluate AlayaRenderer-Flash on G-buffer streams across content preservation, temporal consistency, cross-window stability, prompt controllability, and runtime efficiency. Our results show that AlayaRenderer-Flash substantially reduces inference cost while preserving the core rendering capabilities of the teacher model. By integrating AlayaRenderer-Flash with a physics engine, we build a fully playable generative world running at 30 FPS.
Original Article
View Cached Full Text

Cached at: 07/22/26, 06:41 AM

Paper page - Generative World Renderer at the Speed of Play

Source: https://huggingface.co/papers/2607.18703

Abstract

GenerativeworldrendererAlayaRendererreceivesstructuredworldstatesexportedfromphysicsenginesandsynthesizesRGBframes.Unlikemodelsthatgenerateframesfromtext/control-hintsprompts,AlayaRendererpreservesscenestructurewithoutalteringtheunderlyingworlddynamics.Thisdemonstratesanalternativepathtowardinteractiveworldmodelinganduser-controllableplay.However,theoriginalAlayaRendereristoocomputationallyexpensiveforreal-timedeployment.ThistechnicalreportintroducesAlayaRenderer-Flash,areal-time-orientedgenerativeforwardworldrendererthatpushesAlayaRendererfrom0.56FPSto31.54FPS,reachingthespeedofplay.AlayaRenderer-Flashreformulatestheoriginalrendererasafew-stepautoregressivestreamingmodelandintroduceslightweightdistilledcodecsforefficientlatentencodingandframereconstruction.Itretainstheteachermodel’sG-bufferandtext-promptinterfaceswhileenablingcontinuousrenderingoverinputstreamsofunboundedlength.WeevaluateAlayaRenderer-FlashonG-bufferstreamsacrosscontentpreservation,temporalconsistency,cross-windowstability,promptcontrollability,andruntimeefficiency.OurresultsshowthatAlayaRenderer-Flashsubstantiallyreducesinferencecostwhilepreservingthecorerenderingcapabilitiesoftheteachermodel.ByintegratingAlayaRenderer-Flashwithaphysicsengine,webuildafullyplayablegenerativeworldrunningat30FPS.

View arXiv pageView PDFProject pageGitHub16Add to collection

Get this paper in your agent:

hf papers read 2607\.18703

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2607.18703 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2607.18703 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2607.18703 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

AlayaWorld: Long-Horizon and Playable Video World Generation

Hugging Face Daily Papers

AlayaWorld is an open-source framework for building interactive generative worlds that enables real-time user interaction and supports diverse actions. It unifies the complete development pipeline from data preparation to deployment.

AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report

Hugging Face Daily Papers

AlayaWorld is a 15B-parameter interactive video world model that generates 24-fps video at 540p and 720p, using autoregressive latent chunk generation with bounded visual context and distillation to reduce inference steps. It achieves state-of-the-art performance on the iWorld-Bench for long-horizon generation.