Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention
Summary
This paper identifies a localized 'entity binding failure' in Speech Large Language Models (SLLMs) where logical reasoning involving entity tracking collapses to chance-level accuracy, and proposes Entity-Aware Chain-of-Thought (EA-CoT) prompting to resolve this, achieving up to 24.4% absolute accuracy improvement.
View Cached Full Text
Cached at: 06/05/26, 02:14 AM
# Entity Binding Failures in Speech LLM Reasoning: Diagnosis and Chain-of-Thought Intervention Source: [https://arxiv.org/abs/2606.04474](https://arxiv.org/abs/2606.04474) [View PDF](https://arxiv.org/pdf/2606.04474) > Abstract:Speech Large Language Models \(SLLMs\) underperform their text counterparts on complex reasoning\. We reveal that this modality gap is not a uniform cognitive deficit\. Evaluating three diverse SLLMs, we show speech\-to\-text \(S2T\) matches or exceeds text\-to\-text \(T2T\) on spatial, syntactic, and factual tasks\. However, on logical tasks requiring entity tracking, S2T accuracy collapses to chance\. We diagnose this localized degradation as an entity binding failure: continuous speech features cause models to lose precise entity\-property associations during implicit reasoning\. To resolve this, we propose Entity\-Aware Chain\-of\-Thought \(EA\-CoT\), forcing SLLMs to explicitly enumerate entities and bind them to claims before reasoning\. Strikingly, EA\-CoT bridges the gap, even when spoken names are misrecognized, yielding up to a 24\.4% absolute accuracy improvement\. Ablations confirm these gains stem entirely from explicit semantic binding, reframing the gap as a resolvable bottleneck\. ## Submission history From: Ming\-Hao Hsu \[[view email](https://arxiv.org/show-email/da6e2e4b/2606.04474)\] **\[v1\]**Wed, 3 Jun 2026 05:44:09 UTC \(73 KB\)
Similar Articles
Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations
This paper presents a comprehensive empirical evaluation of how large language models handle corruptions in chain-of-thought reasoning steps, testing 13 models across 5 perturbation types (MathError, UnitConversion, Sycophancy, SkippedSteps, ExtraSteps) on mathematical reasoning tasks. The findings reveal heterogeneous vulnerability patterns with implications for deploying LLMs in multi-stage reasoning pipelines.
Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models
This paper introduces a white-box diagnostic framework that localizes instruction hierarchy failures in reasoning language models into identification, conflict resolution, and response realization stages. It evaluates several models and proposes two training-free self-monitoring mechanisms that reduce non-compliance by 81–99%.
Cell-Based Representation of Relational Binding in Language Models
Study reveals that LLMs encode discourse-level relational binding through Cell-based Binding Representation (CBR), a low-dimensional linear subspace where each cell maps to entity-relation pairs, providing causal evidence for how models track entities and relations.
Constraint-Anchored Reasoning Traces
Proposes CART, a neuro-symbolic framework that interleaves natural language reasoning steps with symbolic constraint assertions to detect and correct errors early in chain-of-thought traces for multimodal LLMs. Reduces snowball rate from 65% to 14% and improves accuracy on multiple benchmarks.
Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning
ACTS (Agentic Chain-of-Thought Steering) formulates LLM reasoning control as a Markov decision process where a controller agent adaptively steers a frozen reasoner during inference using reasoning strategies and steering phrases. The approach achieves comparable accuracy to full-thinking models with significant token savings, enabling controllable accuracy-efficiency trade-offs.