@huang_biwei: Thrilled to share CausalWM, our causal world model v1 built based on Causal Chain-of-Thought (CoT). It currently ranks …
Summary
CausalWM is a causal world model that uses Chain-of-Thought to predict future frames by capturing physical dependencies step-by-step, ranking top on benchmarks like TriWorldBench and PAI-Bench.
View Cached Full Text
Cached at: 09/19/26, 09:09 PM
Thrilled to share CausalWM, our causal world model v1 built based on Causal Chain-of-Thought (CoT). It currently ranks No. 1 on TriWorldBench and the robot domain of PAI-Bench.
Many world models predict the future frames directly from current observations with language or action conditions. This can produce visually convincing videos at first glance, while still getting many subtle but important physical details wrong.
Because the underlying physical variables remain entangled in implicit representations, it is difficult to tell whether the model has truly captured the relevant physical mechanisms or is merely relying on shortcuts that produce plausible-looking results.
With CausalWM, we bring Causal CoT into future video prediction. The model follows an explicit sequence:
Optical Flow → Geometry / Pointmap → Future RGB
Each step in the causal CoT captures a meaningful intermediate transition, allowing the model to progressively capture causal dependencies underlying physical evolution.
One result I find especially interesting is the in-context control interface created by Causal CoT. Because our CausalWM has learned to use new visual signals in causal CoT. With limited fine-tuning, any useful features (e.g., simulator-rendered robot trajectories) can be added as in-context control, to guide it to generate consistent future videos.
This in-context learning ability gives us a practical way for physical reasoning and causal intervention.
Links in the thread below.
Similar Articles
CausalWAM: Learning the Causes of Actions in World Action Models
CausalWAM proposes adding a sparse routing path to a pretrained World Action Model's action head so that generated actions depend only on action-relevant latent variables, with provable identification of causal structure up to permutation without temporal independence assumptions. Experiments on synthetic data and real robots show improved closed-loop success efficiency.
When Do Causal World Models Help Modular LLM Agents
论文提出 FedCausalCompose,一个面向模块化 LLM 智能体的因果世界模型框架,探讨因果结构在何种条件下有助于跨模块工具调用,并指出只有当跨模块接口在统计上可识别且以决策可用的形式呈现时,因果世界模型才真正有效。
Can World and Action Modeling Benefit Each Other under Unified Causal Training?
该论文提出 OneWM,探讨世界模型与动作建模在统一因果训练框架下如何相互增益,并展示了真实机器人操作(如积木堆叠、早餐准备)及模型自回归想象式推演的演示。
Learning Counterfactual World Models for Embodied Reasoning under Partial Observability
This paper introduces Counterfactual Latent World Models (CLWM) to address counterfactual collapse in world models, improving planning success in embodied reasoning under partial observability through contrastive objectives.
YoCausal: How Far is Video Generation from World Model? A Causality Perspective
This paper introduces YoCausal, a benchmark based on the Violation of Expectation paradigm from cognitive science, to evaluate whether video diffusion models truly understand causality or merely overfit to temporal patterns. Evaluation of 13 state-of-the-art models reveals a significant gap compared to human-level causal cognition.