GeoState: Learning View-Decoupled Geometry States for 3D World Modeling

Hugging Face Daily Papers Papers

Summary

GeoState提出了一种视角解耦的几何表示,将场景动态与相机运动分离以实现预测性3D世界建模,在Waymo上超越先前方法,并可零样本泛化到KITTI和nuScenes。

Recent 3D world models increasingly use features from geometry foundation models (GFMs) as predictive world states, benefiting from their rich geometric priors. However, the view dependence of these features entangles scene dynamics with camera-induced variation, making the resulting state evolution harder to predict. We propose GeoState, a view-decoupled geometry representation for predictive 3D world modeling that separates scene-state evolution from camera-dependent observation. Specifically, a scene tokenizer aggregates multi-view GFM features into a view-decoupled scene state, which a geometry decoder queries using camera rays. An autoregressive world model then predicts future scene states, while camera motion is modeled separately. The predicted states can therefore be decoded under either predicted or externally specified cameras, while retaining a single context-derived scale throughout the rollout without per-frame scale alignment. Experiments show that GeoState outperforms prior 3D world models on Waymo, supports geometrically consistent cross-view querying, and generalizes zero-shot to KITTI and nuScenes. Project page: https://hongchang-liu.github.io/GeoState-project-page/
Original Article
View Cached Full Text

Cached at: 10/19/26, 03:26 AM

Paper page - GeoState: Learning View-Decoupled Geometry States for 3D World Modeling

Source: https://huggingface.co/papers/2610.22343

Abstract

GeoState introduces a view-independent geometric representation that separates scene dynamics from camera motion for predictive 3D world modeling, enabling consistent multi-view forecasting and cross-dataset generalization.

Recent 3D world models increasingly use features fromgeometry foundation models(GFMs) as predictive world states, benefiting from their rich geometric priors. However, the view dependence of these features entangles scene dynamics with camera-induced variation, making the resulting state evolution harder to predict. We propose GeoState, aview-decoupled geometry representationfor predictive 3D world modeling that separates scene-state evolution from camera-dependent observation. Specifically, ascene tokenizeraggregates multi-view GFM features into a view-decoupled scene state, which ageometry decoderqueries usingcamera rays. Anautoregressive world modelthen predicts future scene states, while camera motion is modeled separately. The predicted states can therefore be decoded under either predicted or externally specified cameras, while retaining a single context-derived scale throughout the rollout without per-frame scale alignment. Experiments show that GeoState outperforms prior 3D world models on Waymo, supports geometrically consistentcross-view querying, and generalizes zero-shot to KITTI and nuScenes. Project page: https://hongchang-liu.github.io/GeoState-project-page/

View arXiv pageView PDFProject pageGitHub9Add to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.22343 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.22343 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2610.22343 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space

Hugging Face Daily Papers

GeoVerse is a framework for synthesizing world-consistent novel views by performing generation in a geometric latent space from a 3D foundation model and injecting appearance priors from a video generative model, demonstrating improved visual quality and geometric consistency over existing methods.

SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space

Hugging Face Daily Papers

This paper proposes SG-WAM, a self-guided framework for learning geometry-aware action-conditioned world models directly in policy-derived representation space. It achieves state-of-the-art success rates on LIBERO and LIBERO-Plus benchmarks, outperforming strong baselines in real-world evaluations.

WorldRecon: Generative Multi-View Mesh Reconstruction for Large-Scale 3D World

Hugging Face Daily Papers

WorldRecon 提出一种生成式多视角网格重建框架,可从无位姿 RGB 图像重建大规模 3D 场景的完整网格。它将 TRELLIS.2 生成模型与重建式条件架构结合,通过邻域感知潜在修补和因果世界生成保证场景级一致性,在合成与真实室内场景上分别将 Chamfer 距离降低 14.9% 和 43.1%,达到最先进性能。