Code World Model: Coding Agent as World Brain
Summary
The paper introduces Code World Model, a framework that combines language models for reasoning and coding with video models for visual rendering to simulate persistent world evolution in an open-ended manner.
View Cached Full Text
Cached at: 08/27/26, 03:18 AM
Paper page - Code World Model: Coding Agent as World Brain
Source: https://huggingface.co/papers/2608.25927
Abstract
Code World Model separates persistent world dynamics from visual rendering by using a language model to generate executable state updates and a video model to render observations from proxy representations.
World modelsaim to simulate how complex environments evolve under actions and events, yet existingvideo-based world modelsprimarily learn dynamics from visual observations, which reveal outcomes rather than the underlying knowledge, rules, and mechanisms governing world evolution. This makes it difficult to maintain persistent consequences and support coherent, open-ended evolution. We introduce Code World Model, a framework that separates world evolution from visual realization by combining the reasoning and coding capabilities oflanguage modelswith the generative priors ofvideo models. Acoding agentserves as the world brain, reasoning about events and their consequences and generatingexecutable codeto maintain persistent world state and perform rule-consistent evolution. To connect executable state with visual generation, we introduce aproxy representationthat encodes frame-wisespatiotemporal constraintsand is compiled into a proxy video, which conditions avideo modelto render high-fidelity visual observations. We further develop data pipelines for constructing aligned proxy-observation pairs from gameplay and real-world videos. Afterfine-tuningon paired gameplay data, MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by thecoding agentwhile preserving rich visual details and dynamics. These results demonstrate the potential of combining code for persistent world evolution withvideo models for flexible visual realization, providing a new path towardopen-ended world models.
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2608\.25927
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2608.25927 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2608.25927 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2608.25927 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Coding Agent Is Good As World Simulator
This paper presents an agentic framework that uses coding agents to generate physically plausible world simulations from natural language prompts, outperforming video-based models in physical accuracy and instruction fidelity.
Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning
Code-as-World introduces a paradigm that represents physical environments as executable code to enable quantitative reasoning for vision-language models, using an agentic discovery loop for scalable supervision and achieving state-of-the-art performance.
Code2Games: Enabling Coding Agents for Gaming World Generation
Code2Games is an agentic framework that coordinates coding agents to build consistent gaming worlds from natural-language game intents, adapting them to Unreal Engine 5 via execution-guided reconstruction, and introduces the GameCode4D benchmark for evaluating game-world generation quality.
VisualPatchWorld: Code World Models as Latent Structured Representations for Planning
VisualPatchWorld introduces a method for learning world dynamics as code, enabling inspectable and editable simulators from data. It achieves strong planning success in navigation and manipulation tasks.
Qwen-AgentWorld: Language World Models for General Agents
Qwen-AgentWorld introduces language world models for agentic environments, covering seven domains with long chain-of-thought reasoning. The work includes a new benchmark, AgentWorldBench, and shows that world modeling improves downstream agent performance.