Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models

Hugging Face Daily Papers Papers

Summary

Light Interaction introduces a training-free inference acceleration framework for interactive video world models, using adaptive context management, denoising cache acceleration, and 3D block sparse attention to achieve up to 2.59x speedup while maintaining competitive visual quality.

Interactive video world models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time game simulation, virtual scene navigation, and embodied AI training. However, scaling to long interactive trajectories is prohibitively expensive due to growing context memory, quadratic attention complexity, and repeated denoising steps. We present Light Interaction, a training-free inference acceleration framework for interactive video world models. Our key insight is that interaction naturally enables trajectory-dependent adaptive computation: retrieved spatial memory can be discarded during novel exploration, temporal context can be adjusted according to local latent dynamics, and early-step model outputs can be reused when the camera revisits familiar regions. Based on this insight, Light Interaction combines adaptive context management, denoising cache acceleration, and hardware-software co-designed 3D block sparse attention with fused Triton kernels. Evaluated on HY-WorldPlay and Matrix-Game-3.0, Light Interaction achieves up to 2.59x speedup without model retraining while maintaining competitive visual quality.
Original Article
View Cached Full Text

Cached at: 06/01/26, 03:17 AM

Paper page - Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models

Source: https://huggingface.co/papers/2605.31158

Abstract

Light Interaction accelerates interactive video world models through adaptive computation strategies and optimized attention mechanisms without requiring model retraining.

Interactive videoworld models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time game simulation, virtual scene navigation, and embodied AI training. However, scaling to long interactive trajectories is prohibitively expensive due to growing context memory, quadratic attention complexity, and repeated denoising steps. We present Light Interaction, a training-free inference acceleration framework forinteractive videoworld models. Our key insight is that interaction naturally enablestrajectory-dependent adaptive computation: retrievedspatial memorycan be discarded during novel exploration,temporal contextcan be adjusted according to local latent dynamics, and early-step model outputs can be reused when the camera revisits familiar regions. Based on this insight, Light Interaction combines adaptive context management,denoising cache acceleration, and hardware-software co-designed3D block sparse attentionwith fusedTriton kernels. Evaluated on HY-WorldPlay and Matrix-Game-3.0, Light Interaction achieves up to 2.59x speedup without model retraining while maintaining competitive visual quality.

View arXiv pageView PDFProject pageAdd to collection

Get this paper in your agent:

hf papers read 2605\.31158

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2605.31158 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2605.31158 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2605.31158 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

NVIDIA Cosmos Opens New Tools to Train, Evaluate and Deploy World Models

NVIDIA Blog

NVIDIA expanded its Cosmos platform with new training tools, simulation checkpoints and Cosmos Data Factory blueprints to help developers build, evaluate and deploy world models for physical AI. Partners including Porsche, Volkswagen Group, ANYbotics, Microsoft Azure, Nebius and CoreWeave are already using the blueprints to accelerate autonomous vehicle and robotics development.

GRAFT: Restoring the Missing Sampling Interface in Continuous Diffusion Language Models

arXiv cs.CL

论文揭示连续扩散语言模型(如ELF)因生成过程缺少逐步离散采样步骤而导致长尾词汇严重缺失(稀有词生成率仅为人类文本的0.30×),并提出训练无关的GRAFT方法,通过在模型未确定时提交稀有词再重新生成序列,将稀有词比例恢复至人类水平的0.82–1.10×。