Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention
Summary
This paper identifies a localized 'entity binding failure' in Speech Large Language Models (SLLMs) where logical reasoning involving entity tracking collapses to chance-level accuracy, and proposes Entity-Aware Chain-of-Thought (EA-CoT) prompting to resolve this, achieving up to 24.4% absolute accuracy improvement.
View Cached Full Text
Cached at: 06/05/26, 02:14 AM
# Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention Source: [https://arxiv.org/abs/2606.04474](https://arxiv.org/abs/2606.04474) [View PDF](https://arxiv.org/pdf/2606.04474) > Abstract:Speech Large Language Models \(SLLMs\) underperform their text counterparts on complex reasoning\. We reveal that this modality gap is not a uniform cognitive deficit\. Evaluating three diverse SLLMs, we show speech\-to\-text \(S2T\) matches or exceeds text\-to\-text \(T2T\) on spatial, syntactic, and factual tasks\. However, on logical tasks requiring entity tracking, S2T accuracy collapses to chance\. We diagnose this localized degradation as an entity binding failure: continuous speech features cause models to lose precise entity\-property associations during implicit reasoning\. To resolve this, we propose Entity\-Aware Chain\-of\-Thought \(EA\-CoT\), forcing SLLMs to explicitly enumerate entities and bind them to claims before reasoning\. Strikingly, EA\-CoT bridges the gap, even when spoken names are misrecognized, yielding up to a 24\.4% absolute accuracy improvement\. Ablations confirm these gains stem entirely from explicit semantic binding, reframing the gap as a resolvable bottleneck\. ## Submission history From: Ming\-Hao Hsu \[[view email](https://arxiv.org/show-email/da6e2e4b/2606.04474)\] **\[v1\]**Wed, 3 Jun 2026 05:44:09 UTC \(73 KB\)
Similar Articles
Legible Failures: Detecting and Repairing In-Context Binding Errors
This paper introduces 'legible failures' in language models, where models possess correct information in hidden states but fail to use it, and shows that linear probes can detect and repair such failures through steering interventions.
A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM
A*-Thought-V2 models chain-of-thought reasoning as hidden-state trajectories, using geometric dynamics to compress non-essential steps into latent tokens, improving accuracy and efficiency in LLM reasoning.
Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations
This paper presents a comprehensive empirical evaluation of how large language models handle corruptions in chain-of-thought reasoning steps, testing 13 models across 5 perturbation types (MathError, UnitConversion, Sycophancy, SkippedSteps, ExtraSteps) on mathematical reasoning tasks. The findings reveal heterogeneous vulnerability patterns with implications for deploying LLMs in multi-stage reasoning pipelines.
Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models
This paper introduces a white-box diagnostic framework that localizes instruction hierarchy failures in reasoning language models into identification, conflict resolution, and response realization stages. It evaluates several models and proposes two training-free self-monitoring mechanisms that reduce non-compliance by 81–99%.
Mean-Field Dynamics of Chain-of-Thought Reasoning in Large Language Models
The paper proposes a mean-field framework to model chain-of-thought reasoning in LLMs as a guided discovery process on a clue graph, deriving an ODE for the fraction of discovered clues and validating it experimentally.