Soft Spatial Reasoning

Hugging Face Daily Papers Papers

Summary

The paper proposes Soft Spatial Reasoning, a post-training framework that introduces adaptive "soft thinking" for spatial tasks in Large Vision-Language Models, where intermediate reasoning steps mix token embeddings instead of committing to a single discrete token. An AdaptSoft controller dynamically adjusts softness based on hidden state and predictive uncertainty, outperforming hard and fixed-soft CoT baselines on spatial benchmarks.

Large Vision-Language Models (LVLMs) commonly perform spatial reasoning through chain-of-thought (CoT), encoding intermediate reasoning as autoregressive sequences of discrete language tokens. Such hard thinking requires committing to a single token at each step, even when the correct spatial interpretation remains uncertain. This early commitment constitutes premature discretization: an incorrect token selection can propagate errors through subsequent reasoning. We propose Soft Spatial Reasoning, a post-training framework that introduces soft thinking for spatial tasks in LVLMs. At each intermediate reasoning step, the LVLM forms a continuous soft state by mixing token embeddings rather than selecting a single token, allowing multiple candidate continuations to influence the next step. The appropriate degree of softness, however, can vary across reasoning steps: retaining multiple candidates may preserve a useful spatial interpretation, but if those candidates imply conflicting spatial relations, mixing them may interfere with subsequent reasoning. At the core of Soft Spatial Reasoning is AdaptSoft, a controller that uses the current hidden state and predictive uncertainty to adapt the degree of softness at each reasoning step. To train AdaptSoft, we introduce a gradient-alignment learning objective that provides a step-specific learning signal for softness control without intermediate reasoning supervision. Across diverse spatial benchmarks, Soft Spatial Reasoning outperforms hard and fixed-soft CoT baselines using the same backbone, as well as a range of existing LVLMs. The source code is available at https://github.com/rafiibnsultan/Soft_Spatial_Reasoning
Original Article
View Cached Full Text

Cached at: 10/01/26, 04:23 PM

Paper page - Soft Spatial Reasoning

Source: https://huggingface.co/papers/2609.38717

Abstract

LargeVision-LanguageModels(LVLMs)commonlyperformspatialreasoningthroughchain-of-thought(CoT),encodingintermediatereasoningasautoregressivesequencesofdiscretelanguagetokens.Suchhardthinkingrequirescommittingtoasingletokenateachstep,evenwhenthecorrectspatialinterpretationremainsuncertain.Thisearlycommitmentconstitutesprematurediscretization:anincorrecttokenselectioncanpropagateerrorsthroughsubsequentreasoning.WeproposeSoftSpatialReasoning,apost-trainingframeworkthatintroducessoftthinkingforspatialtasksinLVLMs.Ateachintermediatereasoningstep,theLVLMformsacontinuoussoftstatebymixingtokenembeddingsratherthanselectingasingletoken,allowingmultiplecandidatecontinuationstoinfluencethenextstep.Theappropriatedegreeofsoftness,however,canvaryacrossreasoningsteps:retainingmultiplecandidatesmaypreserveausefulspatialinterpretation,butifthosecandidatesimplyconflictingspatialrelations,mixingthemmayinterferewithsubsequentreasoning.AtthecoreofSoftSpatialReasoningisAdaptSoft,acontrollerthatusesthecurrenthiddenstateandpredictiveuncertaintytoadaptthedegreeofsoftnessateachreasoningstep.TotrainAdaptSoft,weintroduceagradient-alignmentlearningobjectivethatprovidesastep-specificlearningsignalforsoftnesscontrolwithoutintermediatereasoningsupervision.Acrossdiversespatialbenchmarks,SoftSpatialReasoningoutperformshardandfixed-softCoTbaselinesusingthesamebackbone,aswellasarangeofexistingLVLMs.Thesourcecodeisavailableathttps://github.com/rafiibnsultan/Soft_Spatial_Reasoning

View arXiv pageView PDFGitHub0Add to collection

Get this paper in your agent:

hf papers read 2609\.38717

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.38717 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.38717 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.38717 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models

Hugging Face Daily Papers

This paper introduces SR-REAL, a unified framework for spatial vision-language models that combines linguistic deduction and 3D geometric reasoning via reinforcement learning, enabling robust multi-step spatial reasoning across diverse tasks.

SpatialASM: Internalizing Active Mentalization for Spatial Reasoning

Hugging Face Daily Papers

The paper introduces SpatialASM, a framework that trains large vision-language models to actively plan task-relevant viewpoints and mentally imagine missing spatial evidence via novel-view synthesis scaffolding, improving spatial reasoning across four backbones and seven benchmarks without extra views at inference.