Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors

Hugging Face Daily Papers Papers

Summary

The paper finds that multi-hop RAG methods amplify ASR corruption in queries, reducing robustness in speech-based retrieval systems compared to naive methods.

Speech-based applications pass spoken queries through automatic speech recognition (ASR) before any retrieval module, so ASR errors enter the pipeline as a fixed upstream constraint. We empirically test whether two extensions to standard retrieval-augmented generation (RAG), entity-graph linking and iterative reformulation, absorb or amplify these errors. Using four English accents synthesized through neural TTS, we evaluate four RAG configurations on three multi-hop QA benchmarks (HotpotQA, 2WikiMultiHopQA and MuSiQue) against a clean-text oracle. Although the structurally richer configurations generally retain higher absolute F1 under ASR input, both extensions amplify the error: the F1 gap from clean text to the highest-WER accent is 36-67% larger under their combination than under naive dense retrieval, on all three benchmarks. The dominant failure mode is corruption of one or more query entities, accounting for 87-96% of degradation cases on 2WikiMultiHopQA across all four methods. Two lightweight surface-form mitigations leave most of the gap intact, indicating that downstream retrieval structure amplifies remaining entity errors. We release code and data at https://github.com/ZhenghuaBao/spoken-multihop-rag .
Original Article
View Cached Full Text

Cached at: 08/25/26, 08:36 AM

Paper page - Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors

Source: https://huggingface.co/papers/2608.22872 Speech interfaces put ASR in front of retrieval, so the query a RAG system sees is already corrupted. We test whether the standard multi-hop methods, entity-graph linking and iterative reformulation, absorb that corruption or amplify it.

The findings suggest that they amplify it. The structurally richer configurations generally reach higher absolute F1 under ASR input, but they give up more of their clean-text advantage: the gap from clean text to the highest-WER accent is 36-67% larger under IRCoT+HippoRAG2 than under naive dense retrieval, on all three benchmarks. Corruption of one or more query entities is the dominant failure mode, accounting for 87-96% of degradation cases on 2WikiMultiHopQA across all four methods.

Two lightweight surface-form mitigations, N-best decoding and phonetic entity correction, leave most of the gap intact, which points at retrieval structure rather than transcription surface form.

We release the code and a transcript dataset covering 3 multi-hop QA benchmarks x 4 English accents (3,000 questions, 12,000 rows).

Similar Articles

When Retrieval Doesn't Help: A Large-Scale Study of Biomedical RAG

arXiv cs.CL

A large-scale study across 5 models (7B–72B), 10 biomedical QA datasets, 4 retrieval methods, and 4 corpora finds that RAG yields only small and inconsistent gains (1–2 points) over no-retrieval baselines in biomedical question answering. The study concludes that the main bottleneck is not retrieval quality but models' limited ability to effectively use retrieved evidence.

@vintcessun: Feeding too many documents into RAG causes retrieval quality to drop from 75% to 40%? Vector search is diluted by a large amount of irrelevant content, causing a sharp drop in hit rate in real deployment. Root cause: heterogeneous documents are retrieved together, noise drowns out signal. Multi-agent orchestration seems intelligent but actually introduces a precision-fidelity paradox—poor configuration leads to failure in both aspects. The paper proposes MA…

X AI KOLs Timeline

This paper identifies 'vector search dilution' in RAG systems when scaling to large heterogeneous document collections, where accuracy dropped from 75% to 40% in a real-world deployment. The proposed MASDR-RAG method uses domain scoping via organizational metadata before retrieval, improving P@10 from 0.77 to 0.86 with low cost and easy deployment.