LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
Summary
LaWAM enables efficient robot control by predicting compact latent visual subgoals instead of expensive video generation, achieving state-of-the-art success rates with up to 24x lower latency than pixel-space world action models.
View Cached Full Text
Cached at: 06/16/26, 03:32 PM
Paper page - LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
Source: https://huggingface.co/papers/2606.15768 Authors:
,
,
,
,
,
,
,
,
,
,
Abstract
LaWAM enables efficient robot control by predicting compact latent visual subgoals instead of expensive video generation, achieving high performance with reduced computational latency.
Vision-Language-Action models(VLAs) leverage large-scale vision-language pretraining for semantic robot control, but often lack explicit foresight into how robot actions change the scene.World-Action Models(WAMs) address this limitation by conditioning policies on predicted futures, yet existing approaches typically rely on computationally expensive video generation with substantial pixel-level redundancy. We present LaWAM, a Latent World Action Model that exposespredictive dynamicstorobot policiesthrough compactlatent visual subgoalsinstead of reconstructed future video. At the core of LaWAM is a latent-action-conditioned Latent World Model (LaWM). We obtain LaWM by training alatent action modelin the latent space of a pretrainedvision foundation modeland repurposing itsforward decoderto predict future observation features forscene evolution. LaWAM then conditions action generation on these predictedlatent visual subgoalsto enable dynamics-aware robot control. LaWAM achieves state-of-the-art or competitive success rates (SRs) across LIBERO (98.6% SR), RoboTwin (91.22% SR), and real-world manipulation tasks while retaining low-latency inference. LaWAM runs in 187 ms peraction-chunk predictionand achieves up to 24x lower wall-clock latency than pixel-space WAMs.
View arXiv pageView PDFProject pageGitHub14Add to collection
Get this paper in your agent:
hf papers read 2606\.15768
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2606.15768 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2606.15768 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2606.15768 in a Space README.md to link it from this page.
Collections including this paper1
Similar Articles
Light-WAM: Efficient World Action Models with State-Fusion Action Decoding
Light-WAM is a lightweight world action model for efficient robot manipulation that uses a compact video backbone and downsampled latent space for future-video supervision, achieving high performance with low inference latency.
Latent Action as Intention Enables Efficient Future Imagination for World Action Models
LAWA is a world action model that uses latent actions to enable efficient future imagination for robot control, achieving state-of-the-art performance with reduced inference latency. It improves over baselines in generalization and efficiency without generating future observations.
Predicting Consequences and Reinforcing Navigation Policies with Latent World Models
This paper proposes a Latent World Model (LWM) for robot navigation that predicts action-conditioned latent feature compatibility, enabling policy learning from unlabeled video data and reinforcement learning without additional environment interaction, outperforming existing methods.
World Action Modeling with Progressive Visual Planning
ProWAM is a progressive world action model that jointly predicts robot actions and an ordered sequence of sparse visual sub-goals, enabling efficient long-horizon control without dense video generation. It achieves state-of-the-art results on LIBERO-Plus and RoboTwin, plus 70% zero-shot real-world success.
World Action Agent: Harnessing VLMs for Robot Manipulation via World Action Rehearsal
The paper presents World Action Agent (WAA), a multi-agent system that uses Vision-Language Models (VLMs) for robot manipulation through a visual action workspace with contact views, action rehearsal, and in-view correction, achieving state-of-the-art results on benchmarks.