Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models
Summary
Light Interaction introduces a training-free inference acceleration framework for interactive video world models, using adaptive context management, denoising cache acceleration, and 3D block sparse attention to achieve up to 2.59x speedup while maintaining competitive visual quality.
View Cached Full Text
Cached at: 06/01/26, 03:17 AM
Paper page - Light Interaction: Training-Free Inference Acceleration for Interactive Video World Models
Source: https://huggingface.co/papers/2605.31158
Abstract
Light Interaction accelerates interactive video world models through adaptive computation strategies and optimized attention mechanisms without requiring model retraining.
Interactive videoworld models generate video chunk by chunk in response to user-controlled camera movements, enabling applications such as real-time game simulation, virtual scene navigation, and embodied AI training. However, scaling to long interactive trajectories is prohibitively expensive due to growing context memory, quadratic attention complexity, and repeated denoising steps. We present Light Interaction, a training-free inference acceleration framework forinteractive videoworld models. Our key insight is that interaction naturally enablestrajectory-dependent adaptive computation: retrievedspatial memorycan be discarded during novel exploration,temporal contextcan be adjusted according to local latent dynamics, and early-step model outputs can be reused when the camera revisits familiar regions. Based on this insight, Light Interaction combines adaptive context management,denoising cache acceleration, and hardware-software co-designed3D block sparse attentionwith fusedTriton kernels. Evaluated on HY-WorldPlay and Matrix-Game-3.0, Light Interaction achieves up to 2.59x speedup without model retraining while maintaining competitive visual quality.
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2605\.31158
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.31158 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.31158 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.31158 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
@kyutai_labs: Many world models borrow their video autoencoder from text-to-video generators, and with it, a noticeable lag on every …
Kyutai Labs releases CADRE, open causal diffusion representation autoencoders that remove the latency typically inherited from text-to-video generators, enabling real-time world models to react faster on a single GPU.
NVIDIA Cosmos Opens New Tools to Train, Evaluate and Deploy World Models
NVIDIA expanded its Cosmos platform with new training tools, simulation checkpoints and Cosmos Data Factory blueprints to help developers build, evaluate and deploy world models for physical AI. Partners including Porsche, Volkswagen Group, ANYbotics, Microsoft Azure, Nebius and CoreWeave are already using the blueprints to accelerate autonomous vehicle and robotics development.
GRAFT: Restoring the Missing Sampling Interface in Continuous Diffusion Language Models
论文揭示连续扩散语言模型(如ELF)因生成过程缺少逐步离散采样步骤而导致长尾词汇严重缺失(稀有词生成率仅为人类文本的0.30×),并提出训练无关的GRAFT方法,通过在模型未确定时提交稀有词再重新生成序列,将稀有词比例恢复至人类水平的0.82–1.10×。
Second Thoughts: Exploring and Planning through Comparative Imagination in World Models
The paper introduces SDI (Sibling Disagreement in Imagination), a method that unifies exploration and planning in world-model-based RL by using the actor's own rollout variability as a shared reference to decide when a planned action should replace the learned policy, outperforming baselines on Meta-World, Adroit, and DM-Control.
@VraserX: Hollywood is COOKED. Kling 4.0 just dropped and the results are literally indistinguishable from reality. “AI slop” is …
Kling 4.0 has just been released, with claims that its AI-generated video output is nearly indistinguishable from reality, signaling a major leap for AI video generation and potential disruption to traditional filmmaking.