World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications

arXiv cs.LG Papers

Summary

A comprehensive survey of world models that provides a multi-axis taxonomy covering architectures, methodologies, reasoning strategies, and applications across AI domains, including key systems like Dreamer, MuZero, and Sora.

arXiv:2606.00133v1 Announce Type: new Abstract: World models, internal simulators that learn the structure and dynamics of an environment, have emerged as a central paradigm in the pursuit of artificial general intelligence, enabling agents to predict, plan, and reason within learned representations. Despite rapid progress across reinforcement learning, robotics, autonomous driving, and video generation, the field lacks a unified framework integrating its diverse architectural choices, training methods, reasoning mechanisms, and application settings. This survey addresses that gap with a multi-axis taxonomy organized along four dimensions: (i) architecture, encompassing representation format, dynamics formulation, input modality, learning paradigm, and downstream application; (ii) methodological family, including state-space and recurrent approaches, transformer-based models, diffusion-based generators, physics-informed networks, and language-augmented multimodal systems; (iii) reasoning strategy, covering imagination-based planning, latent policy learning, counterfactual reasoning, and planning under uncertainty; and (iv) application domain, spanning robotics, autonomous driving, video prediction, multimodal agents, reinforcement learning, scientific modeling, medical imaging, educational measurement, and business and finance. Tracing the field from early cognitive-science foundations to milestone systems such as PlaNet, the Dreamer family, MuZero, Sora, Cosmos, and Genie, we examine how these dimensions interact and highlight the recent convergence of chain-of-thought reasoning with world-model imagination. We review evaluation protocols and benchmarks, identify persistent challenges such as compounding prediction errors, sim-to-real transfer, and fragmented evaluation, and outline future directions toward unified multimodal world models, foundation-scale interactive simulators, and safe deployment in safety-critical domains.
Original Article
View Cached Full Text

Cached at: 06/02/26, 03:39 PM

# World Models: A Comprehensive Survey of Architectures, Methodologies, Reasoning Paradigms, and Applications
Source: [https://arxiv.org/abs/2606.00133](https://arxiv.org/abs/2606.00133)
Authors:[Arif Hassan Zidan](https://arxiv.org/search/cs?searchtype=author&query=Zidan,+A+H),[Yi Pan](https://arxiv.org/search/cs?searchtype=author&query=Pan,+Y),[Hanqi Jiang](https://arxiv.org/search/cs?searchtype=author&query=Jiang,+H),[Ruiyu Yan](https://arxiv.org/search/cs?searchtype=author&query=Yan,+R),[Wei Ruan](https://arxiv.org/search/cs?searchtype=author&query=Ruan,+W),[Zihao Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+Z),[Lifeng Chen](https://arxiv.org/search/cs?searchtype=author&query=Chen,+L),[Weihang You](https://arxiv.org/search/cs?searchtype=author&query=You,+W),[Xinliang Li](https://arxiv.org/search/cs?searchtype=author&query=Li,+X),[Bowen Chen](https://arxiv.org/search/cs?searchtype=author&query=Chen,+B),[Huawen Hu](https://arxiv.org/search/cs?searchtype=author&query=Hu,+H),[Peilong Wang](https://arxiv.org/search/cs?searchtype=author&query=Wang,+P),[Sizhuang Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+S),[Jing Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+J),[Siyuan Li](https://arxiv.org/search/cs?searchtype=author&query=Li,+S),[Zhengliang Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+Z),[Yu Bao](https://arxiv.org/search/cs?searchtype=author&query=Bao,+Y),[Lin Zhao](https://arxiv.org/search/cs?searchtype=author&query=Zhao,+L),[Lichao Sun](https://arxiv.org/search/cs?searchtype=author&query=Sun,+L),[Dajiang Zhu](https://arxiv.org/search/cs?searchtype=author&query=Zhu,+D),[Xiang Li](https://arxiv.org/search/cs?searchtype=author&query=Li,+X),[Jinglei Lv](https://arxiv.org/search/cs?searchtype=author&query=Lv,+J),[Quanzheng Li](https://arxiv.org/search/cs?searchtype=author&query=Li,+Q),[Wei Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+W),[Tianming Liu](https://arxiv.org/search/cs?searchtype=author&query=Liu,+T),[Wei Zhang](https://arxiv.org/search/cs?searchtype=author&query=Zhang,+W)

[View PDF](https://arxiv.org/pdf/2606.00133)

> Abstract:World models, internal simulators that learn the structure and dynamics of an environment, have emerged as a central paradigm in the pursuit of artificial general intelligence, enabling agents to predict, plan, and reason within learned representations\. Despite rapid progress across reinforcement learning, robotics, autonomous driving, and video generation, the field lacks a unified framework integrating its diverse architectural choices, training methods, reasoning mechanisms, and application settings\. This survey addresses that gap with a multi\-axis taxonomy organized along four dimensions: \(i\) architecture, encompassing representation format, dynamics formulation, input modality, learning paradigm, and downstream application; \(ii\) methodological family, including state\-space and recurrent approaches, transformer\-based models, diffusion\-based generators, physics\-informed networks, and language\-augmented multimodal systems; \(iii\) reasoning strategy, covering imagination\-based planning, latent policy learning, counterfactual reasoning, and planning under uncertainty; and \(iv\) application domain, spanning robotics, autonomous driving, video prediction, multimodal agents, reinforcement learning, scientific modeling, medical imaging, educational measurement, and business and finance\. Tracing the field from early cognitive\-science foundations to milestone systems such as PlaNet, the Dreamer family, MuZero, Sora, Cosmos, and Genie, we examine how these dimensions interact and highlight the recent convergence of chain\-of\-thought reasoning with world\-model imagination\. We review evaluation protocols and benchmarks, identify persistent challenges such as compounding prediction errors, sim\-to\-real transfer, and fragmented evaluation, and outline future directions toward unified multimodal world models, foundation\-scale interactive simulators, and safe deployment in safety\-critical domains\.

## Submission history

From: Arif Hassan Zidan \[[view email](https://arxiv.org/show-email/987e7090/2606.00133)\] **\[v1\]**Thu, 28 May 2026 21:23:24 UTC \(2,289 KB\)

Similar Articles

World Model for Robot Learning: A Comprehensive Survey

Hugging Face Daily Papers

This comprehensive survey reviews the literature on world models for robot learning, covering their roles in policy learning, planning, and simulation. It highlights key paradigms, benchmarks, and future directions for predictive modeling in embodied agents.

World Models Explained: What Every AI Is Missing

Reddit r/ArtificialInteligence

The article explains the concept of world models in detail, comparing them to LLMs, introduces two major camps (pixel prediction and meaning prediction) and representative works such as Dreamer v3, GameNGen, Genie, and JEPA, discusses applications in autonomous driving and robotics, and points out that world models are a key component of physical AI.

World Action Models: The Next Frontier in Embodied AI

Hugging Face Daily Papers

This survey paper introduces World Action Models (WAMs), a unified framework for embodied AI that integrates predictive state modeling with action generation. It provides a taxonomy of existing methods, analyzes the data ecosystem, and outlines evaluation protocols for this emerging paradigm.

World Models Can Change Everything (20 minute read)

TLDR AI

The article discusses the potential paradigm-shifting impact of world models on AI, highlighting investments by Yann LeCun and Fei-Fei Li in this technology as a successor to the current LLM paradigm.

@snowboat84: https://x.com/snowboat84/status/2064135804092645410

X AI KOLs Timeline

This article systematically reviews the evolution of the world model concept from Craik's psychological metaphor in 1943 to the industry explosion in 2024-2026. It details the core ideas and representative works of symbolic AI and deep learning schools (Schmidhuber-Ha, Dreamer series, JEPA, video generation direction), and points out the current state of definition confusion and competition among various schools.