WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon

Hugging Face Daily Papers Papers
interactive-world-models real-time-control long-horizon-consistency memory-compression distillation

Summary

WorldPlay2 is an interactive world model that integrates a factorized hybrid control interface with compressed memory and stable distillation to enable real-time responsiveness and long-horizon consistency in control tasks.

Interactive world models require responding in real time to versatile controls and maintaining long-horizon consistency. However, modeling heterogeneous controls remains difficult, while explosive contexts and unstable distillation impede achieving both long-horizon consistency and real-time responsiveness. In this paper, we present WorldPlay2, an interactive world model that couples a factorized hybrid control interface with a co-design of compressed memory and stable distillation. 1) Our factorized hybrid control interface integrates frame-aligned action control with structured semantic control that explicitly disentangles scene appearance, character identity, and dynamic semantic events, thereby facilitating effective control learning. 2) To achieve efficient long-horizon modeling, we compress historical contexts into compact memory tokens shared by the autoregressive student and the bidirectional teacher. This design enables clip-wise, memory-conditioned score evaluation instead of jointly processing an entire long rollout, substantially reducing distillation overhead. 3) We further propose Stable Forcing, which initializes the autoregressive student via a few-step strategy and leverages full-rollout replay to preserve the quality of long-horizon rollouts, ensuring robust and stable distillation. Extensive experiments demonstrate the strong generalizability of our model and its superior performance compared to existing methods.
Original Article
View Cached Full Text

Cached at: 09/29/26, 08:15 AM

Paper page - WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizon

Source: https://huggingface.co/papers/2609.35560

Abstract

Interactiveworldmodelsrequirerespondinginrealtimetoversatilecontrolsandmaintaininglong-horizonconsistency.However,modelingheterogeneouscontrolsremainsdifficult,whileexplosivecontextsandunstabledistillationimpedeachievingbothlong-horizonconsistencyandreal-timeresponsiveness.Inthispaper,wepresentWorldPlay2,aninteractiveworldmodelthatcouplesafactorizedhybridcontrolinterfacewithaco-designofcompressedmemoryandstabledistillation.1)Ourfactorizedhybridcontrolinterfaceintegratesframe-alignedactioncontrolwithstructuredsemanticcontrolthatexplicitlydisentanglessceneappearance,characteridentity,anddynamicsemanticevents,therebyfacilitatingeffectivecontrollearning.2)Toachieveefficientlong-horizonmodeling,wecompresshistoricalcontextsintocompactmemorytokenssharedbytheautoregressivestudentandthebidirectionalteacher.Thisdesignenablesclip-wise,memory-conditionedscoreevaluationinsteadofjointlyprocessinganentirelongrollout,substantiallyreducingdistillationoverhead.3)WefurtherproposeStableForcing,whichinitializestheautoregressivestudentviaafew-stepstrategyandleveragesfull-rolloutreplaytopreservethequalityoflong-horizonrollouts,ensuringrobustandstabledistillation.Extensiveexperimentsdemonstratethestronggeneralizabilityofourmodelanditssuperiorperformancecomparedtoexistingmethods.

View arXiv pageView PDFProject pageGitHub9Add to collection

Get this paper in your agent:

hf papers read 2609\.35560

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.35560 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.35560 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.35560 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives

Hugging Face Daily Papers

PlayWorld is a benchmark for evaluating interactive video world models using multi-modal agent players pursuing long-horizon objectives. It assesses geometry consistency, interaction fidelity, and state evolution, revealing that current models struggle with spatial consistency and persistent state evolution.

ReWorld: An Interactive World Model with Long-Horizon Memory

Hugging Face Daily Papers

ReWorld presents an interactive world model that decouples short-horizon control from long-horizon memory using mixed attention windows and distribution-matching LoRA distillation, enabling real-time video generation with high action fidelity and recall.

Infinite Worlds with Versatile Interactions

Hugging Face Daily Papers

This paper introduces LingBot-World 2.0, an advanced world modeling system with unbounded interaction horizons, real-time 720p 60fps video generation, diverse interactive elements (e.g., attacking, spell-casting), and novel multi-agent behavior control via pilot and director agents, along with a shared multi-player interface.

Introducing GWM Worlds 2, a Playable World Model | Runway

Reddit r/singularity

Runway has released GWM Worlds 2, an interactive world model with real-time control capabilities, enabling the generation of 720p/24fps video and 48kHz audio on the fly. It allows users to manipulate the environment via text commands and integrate agents for task execution.