SpatialASM: Internalizing Active Mentalization for Spatial Reasoning

Hugging Face Daily Papers Papers

Summary

The paper introduces SpatialASM, a framework that trains large vision-language models to actively plan task-relevant viewpoints and mentally imagine missing spatial evidence via novel-view synthesis scaffolding, improving spatial reasoning across four backbones and seven benchmarks without extra views at inference.

When solving complex spatial reasoning tasks, ordinary humans naturally revisit the scenes from task-relevant viewpoints and mentally reconstruct the spatial layouts from those viewpoints. But can Large Vision-Language Models (LVLMs) proactively think in the same way? We term this ability Active Spatial Mentalization (ASM), an intrinsic component of visual intelligence that remains substantially underdeveloped in current LVLMs. To bridge this gap, we introduce SpatialASM, a scalable framework to internalize ASM into LVLMs through training-time spatial simulation. SpatialASM employs an allocentric novel-view generator to ground hypothetical viewpoints in visual evidence and produces two complementary forms of supervision: i) explicit ASM trajectories that teach LVLMs when and how to adaptively invoke view planning and imagination during spatial reasoning, and ii) automatically-constructed perspective-taking tasks that further strengthens viewpoint-conditioned scene imagination. On seven benchmarks spanning relatively perception-oriented spatial understanding to more challenging tasks requiring multi-image, cross-view and viewpoint-transformation reasoning, SpatialASM yields performance gain on LVLMs of four LVLM backbones in spatial reasoning while retaining their original general vision capabilities. The experimental results demonstrate that our approach improves average accuracy across the seven spatial benchmarks. And the synthesis of ASM trajectories provides a scalable pathway to alleviate the scarcity of spatial Chain-of-Thought (CoT) supervision for eliciting active viewpoint exploration and mental scene simulation.
Original Article
View Cached Full Text

Cached at: 10/13/26, 02:43 AM

Paper page - SpatialASM: Internalizing Active Mentalization for Spatial Reasoning

Source: https://huggingface.co/papers/2610.13832 With SpatialASM, we explore whether LVLMs can go beyond passively observing the given images and instead actively reason by planning task-relevant viewpoints and mentally imagining what should be visible from them.

We introduce Active Spatial Mentalization (ASM) and build a scalable training framework around it. SpatialASM uses an allocentric novel-view generator as training-time scaffolding to synthesize explicit plan-imagine-reason trajectories and automatically verifiable perspective-taking tasks. In this way, models learn both when to seek missing spatial evidence and how to reconstruct it internally without requiring additional views or a renderer at inference time.

This is our attempt to bring a more human-like form of active spatial exploration into LVLMs and alleviate the scarcity of high-quality spatial reasoning supervision. Across four LVLM backbones and seven spatial benchmarks, SpatialASM improves spatial reasoning performance while preserving general visual capabilities.

We’d love to hear your thoughts and feedback!

image

Similar Articles

Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory

Hugging Face Daily Papers

The paper proposes Spatial Memory Intelligence (SMI), the first framework to use an understanding model (MLLM) to systematically manage spatial memory in long-video world models via four atomic operations: spatial clustering, within-cluster sparsification, action-aware retrieval, and reliability-aware filtering. Experiments show improvements in memory sparsity, generation stability, and spatial consistency across multiple world-model backbones.

SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes

Hugging Face Daily Papers

SpatialAct is a new simulator-grounded benchmark that probes whether VLM agents can perform coherent spatial reasoning and translate it into actions in 3D environments across multi-turn feedback settings. Experiments reveal a significant reasoning-to-action gap, with current VLMs struggling to maintain spatial beliefs and produce reliable actions despite performing well on isolated reasoning tasks.