Text-Graph Synergy: A Bidirectional Verification and Completion Framework for RAG

arXiv cs.AI Papers

Summary

This paper introduces TGS-RAG, a bidirectional verification and completion framework that synergizes text-based and graph-based Retrieval-Augmented Generation to improve multi-hop reasoning accuracy.

arXiv:2605.05643v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) has become a core paradigm for enhancing factual grounding and multi-hop reasoning in Large Language Models (LLMs). Traditional text-based RAG often retrieves logically irrelevant pseudo-evidence, while graph-based RAG is frequently hindered by search-time pruning, which may discard potentially valid reasoning paths. Existing hybrid approaches primarily adopt simple evidence concatenation or unidirectional enhancement, which fails to address the fundamental "Information Island" problem caused by asymmetric reasoning flows between unstructured text and structured graphs. We propose \textbf{TGS-RAG}, a unified framework for \textbf{T}ext-\textbf{G}raph \textbf{S}ynergistic enhancement. TGS-RAG introduces a bidirectional mechanism: (i) a \textbf{Graph-to-Text} channel that employs a Global Voting strategy from visited graph nodes to re-rank and refine textual evidence, filtering out semantic noise; and (ii) a \textbf{Text-to-Graph} channel that utilizes the \textbf{Memory-based Orphan Entity Bridging} algorithm. This algorithm utilizes textual cues to proactively resurrect valid but previously pruned reasoning paths from the search history without additional database overhead. Experimental results on multiple multi-hop reasoning benchmarks demonstrate that TGS-RAG significantly outperforms state-of-the-art baselines, achieving a superior balance between retrieval precision and computational efficiency.
Original Article
View Cached Full Text

Cached at: 05/08/26, 08:29 AM

# A Bidirectional Verification and Completion Framework for RAG
Source: [https://arxiv.org/html/2605.05643](https://arxiv.org/html/2605.05643)
Hong Cai Chen School of Automation, Southeast University, Nanjing 210096, China 220245143@seu\.edu\.cn, chenhc@seu\.edu\.cnCorresponding author\.

###### Abstract

Retrieval\-Augmented Generation \(RAG\) has become a core paradigm for enhancing factual grounding and multi\-hop reasoning in Large Language Models \(LLMs\)\. Traditional text\-based RAG often retrieves logically irrelevant pseudo\-evidence, while graph\-based RAG is frequently hindered by search\-time pruning, which may discard potentially valid reasoning paths\. Existing hybrid approaches primarily adopt simple evidence concatenation or unidirectional enhancement, which fails to address the fundamental ”Information Island” problem caused by asymmetric reasoning flows between unstructured text and structured graphs\. We proposeTGS\-RAG, a unified framework forText\-GraphSynergistic enhancement\. TGS\-RAG introduces a bidirectional mechanism: \(i\) aGraph\-to\-Textchannel that employs a Global Voting strategy from visited graph nodes to re\-rank and refine textual evidence, filtering out semantic noise; and \(ii\) aText\-to\-Graphchannel that utilizes theMemory\-based Orphan Entity Bridgingalgorithm\. This algorithm utilizes textual cues to proactively resurrect valid but previously pruned reasoning paths from the search history without additional database overhead\. Experimental results on multiple multi\-hop reasoning benchmarks demonstrate that TGS\-RAG significantly outperforms state\-of\-the\-art baselines, achieving a superior balance between retrieval precision and computational efficiency\.

![Refer to caption](https://arxiv.org/html/2605.05643v1/figures/1.png)Figure 1:Comparison between isolated retrieval paradigms and the TGS\-RAG framework\. \(a\) Existing paradigms suffer from the ”Information Island” gap: text\-based methods often retrieve semantically similar but logically irrelevantpseudo\-evidence, while graph\-based methods are hindered bybroken reasoning pathsdue to search\-time pruning\. \(b\) TGS\-RAG bridges this gap through a bidirectional synergy mechanism, where graph structure guides the re\-ranking of text to identify true evidence, and textual context facilitates the recovery of pruned but potentially valid reasoning paths\.## 1Introduction

Large Language Models \(LLMs\) have achieved remarkable performance in natural language understanding and generation across a wide range of tasks\. However, despite their impressive parametric capacity, LLMs remain fundamentally limited by their reliance on static internal knowledge and their tendency to produce hallucinated or logically inconsistent responses\(Jiet al\.,[2023](https://arxiv.org/html/2605.05643#bib.bib16)\), particularly in knowledge\-intensive and multi\-hop reasoning scenarios\. Retrieval\-Augmented Generation \(RAG\) has therefore emerged as a central paradigm for grounding LLM outputs in external, verifiable evidence, enabling more factual, controllable, and interpretable generation\(Lewiset al\.,[2020](https://arxiv.org/html/2605.05643#bib.bib13)\)\.

Existing RAG systems predominantly follow two distinct paradigms\.Text\-based RAGretrieves relevant information from large unstructured corpora using dense vector similarity\. While this paradigm offers high coverage, it is prone to retrieving pseudo\-evidence\(Cossio,[2025](https://arxiv.org/html/2605.05643#bib.bib5)\)—textual chunks that are semantically similar to the query but logically irrelevant, and struggle with complex multi\-hop reasoning\. In contrast,Graph\-based RAGleverages structured Knowledge Graphs \(KGs\) to provide high logical interpretability\. However, these systems are often constrained by both structural sparsity in KGs and search\-time pruning that may discard potentially useful reasoning paths\.

Recent research attempts to combine Text\-based RAG and Graph\-based RAG to exploit their complementary strengths\. However, these approaches often rely on simple evidence concatenation or pipeline\-style augmentation, which treat textual and graphical evidence as independent sources, failing to achieve deep integration\. Furthermore, unidirectional enhancement frameworks \(e\.g\., KG\-infused RAG\) typically utilize one modality merely as an auxiliary signal for the other\. Such designs fail to establish a closed\-loop interaction, leaving the deeper potential of mutual verification and co\-discovery largely unexplored\.

At the core of this limitation lies theInformation Island problem: textual evidence and graphical evidence are retrieved and processed in isolation, without a mechanism for mutual validation or collaborative reasoning\. Specifically, current systems lack a principled framework in which \(i\) the structured logical constraints encoded in graphs can guide and refine text retrieval, while simultaneously \(ii\) the rich contextual cues present in unstructured text can validate, enrich, and recover pruned but potentially useful graph reasoning paths\. In practice, this often means that the text and graph channels retrieve evidence that appears relevant on their own, but fails to mutually support a coherent reasoning chain\.

To address these challenges, we proposeText\-Graph Synergy RAG \(TGS\-RAG\)111[https://github\.com/EvannZhongg/TGS\_RAG\.git](https://github.com/EvannZhongg/TGS_RAG.git), a novel framework that enables deep, bidirectional integration between unstructured text and structured knowledge graphs during retrieval\. TGS\-RAG introduces a bidirectional enhancement mechanism: a*Graph\-to\-Text*channel that utilizes structured logic to re\-rank textual chunks, and a*Text\-to\-Graph*channel that leverages contextual clues to validate and complete KG paths\. Our main contributions are as follows:

- •Bidirectional Synergy Framework:We propose TGS\-RAG, a unified framework that breaks the ”information island” barrier by establishing a closed\-loop feedback mechanism: graph structures guide the re\-ranking of textual evidence \(Graph\-to\-Text\), while textual context validates and repairs graph reasoning paths \(Text\-to\-Graph\)\. This closed\-loop design allows the two channels to move beyond simple coexistence and mutually verify the evidence retrieved by each other\.
- •Memory\-based Orphan Entity Bridging:We introduce a novel algorithm that addresses the loss of potentially useful reasoning paths during beam\-search pruning by treating pruned nodes as adeferred reasoning memory\. By leveraging textual cues to ”resurrect” these orphan entities, we recover potentially valid reasoning paths discarded during initial search\.
- •Cost\-Effective Dual\-Channel Reasoning:We design a synergistic scoring mechanism that combines semantic similarity with structural voting\. This approach effectively filters out pseudo\-evidence and achieves an optimal Pareto frontier, delivering state\-of\-the\-art accuracy with significantly lower token consumption than global graph indexing methods\.
- •Empirical Superiority:Extensive experiments on MuSiQue and HotpotQA demonstrate that TGS\-RAG significantly outperforms existing text\-based, graph\-based, and hybrid baselines, particularly in scenarios requiring complex multi\-hop reasoning across disjointed evidence\.

![Refer to caption](https://arxiv.org/html/2605.05643v1/figures/3_1.png)Figure 2:The overall architecture of TGS\-RAG\. The framework operates in three phases: \(1\)Knowledge Base Construction, where text chunks and entities are mapped in a unified vector DB; \(2\)Bidirectional Synergistic Retrieval, the core stage utilizingSemantic Beam Searchto accumulate aVisited Memorycontaining both selected and pruned nodes\. This memory facilitatesGraph\-Guided Re\-rankingviaGlobal Votingand enablesText\-Guided Path Completionbyresurrectingpruned orphan entities from memory to bridge logical gaps; and \(3\)Generation, synthesizing the refined evidence\.
## 2Related Work

The evolution of RAG has transitioned from simple text matching to complex multi\-modal and structural fusion\. Our work builds upon three main research areas\.

### 2\.1Unstructured Retrieval for RAG

Traditional RAG systems primarily rely on unstructured retrieval, where dense vector representations facilitate semantic matching between queries and documents\. Dense Passage Retrieval \(DPR\)Karpukhinet al\.\([2020](https://arxiv.org/html/2605.05643#bib.bib11)\)pioneered the dual\-encoder architecture for open\-domain question answering, significantly improving recall over lexical methods\. Subsequent models like ColBERTKhattab and Zaharia \([2020](https://arxiv.org/html/2605.05643#bib.bib12)\)introduced late interaction mechanisms to capture fine\-grained token\-level similarities\. While these models excel at broad knowledge coverage, they often struggle with multi\-hop queries where semantic similarity does not necessarily imply logical relevance, leading to the retrieval of misleading ”pseudo\-evidence\.”

### 2\.2Structured Retrieval for RAG

To address the logical limitations of text\-based retrieval, recent studies have explored Knowledge Graphs \(KGs\) as structured knowledge sources\. Methods in this category typically extract subgraphs or relational paths to provide deterministic evidence for LLMs\. For instance,G\-RetrieverHeet al\.\([2024](https://arxiv.org/html/2605.05643#bib.bib14)\)employs a GNN\-based adapter to filter irrelevant nodes and edges, targeting efficient subgraph retrieval for textual graph understanding\. Similarly, KG\-based reasoning frameworks like ToGSunet al\.\([2024](https://arxiv.org/html/2605.05643#bib.bib6)\)utilize LLMs as agents to execute path\-searching algorithms \(e\.g\., beam search\) over structured facts\. Beyond path reasoning, recent graph\-based indexing approaches leverage LLM\-generated structures to capture global information\.GraphRAGEdgeet al\.\([2024](https://arxiv.org/html/2605.05643#bib.bib3)\)constructs hierarchical community summaries to answer global queries but suffers from high indexing costs\. In contrast,LightRAGGuoet al\.\([2025](https://arxiv.org/html/2605.05643#bib.bib2)\)introduces a dual\-level retrieval paradigm incorporating both graph structures and vector representations\. However, these indexing\-focused approaches primarily address retrieval efficiency and coverage, but are less equipped to handle scenarios where potentially useful reasoning paths are discarded during search\.

### 2\.3Text\-Graph Integration Paradigms

The integration of text and graphs has become a promising direction for robust RAG systems\. Early approaches typically employed unidirectional enhancement strategies\. For instance, KG\-Infused RAG utilizes graph entities to expand queries for text retrieval, while frameworks likeK​G2​R​A​GKG^\{2\}RAGZhuet al\.\([2025](https://arxiv.org/html/2605.05643#bib.bib1)\)adopt a ”Semantic\-to\-Graph” paradigm, using text seeds from initial semantic retrieval to expand graph components\. However, these methods often face a ”unidirectional bottleneck,” where the strengths of one modality do not actively feed back to correct or complete the other in real\-time\.

To overcome these limitations, recent frameworks have moved toward cross\-source validation\.Think\-on\-Graph 2\.0 \(ToG\-2\)Maet al\.\([2025](https://arxiv.org/html/2605.05643#bib.bib4)\)introduces a tight\-coupling paradigm that iteratively alternates between KG\-based graph retrieval and document\-based context retrieval, using text evidence to prune graph paths and graph structures to guide text retrieval\. While TGS\-RAG shares the high\-level goal of mutual verification, the underlying mechanisms differ substantially\. ToG\-2 follows a subtractive strategy, repeatedly pruning and re\-expanding the search space through costly iterative retrieval\. In contrast, TGS\-RAG adopts an additive strategy via Memory\-based Orphan Entity Bridging, which treats pruning as postponement rather than elimination and directly resurrects pruned paths from the semantic beam search history\. This retrospective repair mechanism enables efficient recovery of logical chains that are difficult to preserve under sparse graph connectivity and search\-time pruning without additional database queries\.

![Refer to caption](https://arxiv.org/html/2605.05643v1/figures/3_2.png)Figure 3:Illustration of the Memory\-based Orphan Entity Bridging algorithm\. The process operates in three steps: \(1\)The Visited Memory: Semantic Beam Search generates a set ofActive Paths\(Pi​n​i​t​i​a​lP\_\{initial\}, blue nodes\) while implicitly storing pruned nodes in theVisited Memory\(Ev​i​s​i​t​e​dE\_\{visited\}, grey area\); \(2\)Contextual Recall: Contextual clues from retrieved text chunks \(Ci​n​i​t​i​a​lC\_\{initial\}\) perform aContextual Scanto identify relevant but pruned ”orphan entities”; \(3\)Path Resurrection: The pruning decision is reversed, and theResurrected Path\(pb​r​i​d​g​ep\_\{bridge\}, orange\) connecting the resurrected entity to the main subgraph is recovered without additional database queries\.

## 3The TGS\-RAG Framework

As illustrated in Figure[2](https://arxiv.org/html/2605.05643#S1.F2), TGS\-RAG is designed as a two\-stage framework that tightly integrates unstructured text and structured knowledge graphs for retrieval\-augmented reasoning\. It consists of an offlineKnowledge Base Constructionstage, responsible for extracting and fusing knowledge from unstructured documents; and an onlineBidirectional Synergistic Retrievalstage, which performs mutual verification and enhancement between text and graph evidence during inference\.

### 3\.1Knowledge Base Construction

Given an unstructured document corpusCC, TGS\-RAG constructs a unified knowledge base through an offline processing pipeline\. We leverage Large Language Models \(LLMs\) to extract salient entitiesEEand their semantic relationsRR\(see extraction prompt in Appendix A\.1\), forming a global knowledge graphG=\(E,R\)G=\(E,R\)\.

Crucially, we establish abidirectional mappingMMbetween the text corpusCCand the knowledge graphGG\. Each relational triplet inGGis explicitly linked to its originating text chunks, while each text chunk is annotated with the entities and relations it contains\. This mapping transforms the knowledge graph from a standalone structure into a reasoning interface over text\. Formally, the knowledge base is defined as a triplet:

K​B=\(C,G,M\)KB=\(C,G,M\)\(1\)whereMMrepresents the bidirectional links betweenCCandGG\. This unified and interconnected knowledge base serves as the foundation for the proposed bidirectional enhanced retrieval framework\.

### 3\.2Dual\-Channel Initial Retrieval

Given a user queryqq, TGS\-RAG first extracts a set of query\-relevant entity mentions using an LLM\. These entities are embedded to obtain vectorsvEv\_\{E\}, which are then used to retrieve a seed entity setEseedE\_\{\\text\{seed\}\}from the knowledge graphGG\.

Starting fromEseedE\_\{\\text\{seed\}\}, TGS\-RAG performs two complementary retrieval processes in parallel: a Text Channel and a Graph Channel\. This dual\-channel design intentionally captures heterogeneous evidence signals that exhibit different failure modes\.

- •Text Channel: This channel performs standard semantic retrieval to quickly recall textual evidence directly related to the user query\. We use the query vectorvqv\_\{q\}of user queryqqto perform vector indexing on the text chunk collectionCC, retrieving the initial text setCi​n​i​t​i​a​lC\_\{initial\}with the highest similarity tovqv\_\{q\}\.
- •Graph Channel: Starting from the seed entity setEs​e​e​dE\_\{seed\}, the Semantic Beam Search algorithm \(see Algorithm 1 in Appendix B\) computes, at each hop, the cosine similarity between the embeddings of neighboring nodes and the query vectorvqv\_\{q\}\. Only the top\-KK\(Beam Width\) most semantically relevant paths are retained for the next expansion step\. This heuristic pruning ensures that the retrieval focuses on the semantic neighborhood of the query, yielding a high\-quality path setPi​n​i​t​i​a​lP\_\{initial\}within a preset depthdd\.

The outcome of this stage is two heterogeneous evidence sets:CinitialC\_\{\\text\{initial\}\}, which emphasizes semantic recall, andPinitialP\_\{\\text\{initial\}\}, which captures structured reasoning paths\.

### 3\.3Synergistic Fusion and Enhancement

After obtaining the initial text evidenceCi​n​i​t​i​a​lC\_\{initial\}and graph path setPi​n​i​t​i​a​lP\_\{initial\}, the TGS\-RAG introduces a bidirectional scoring and discovery mechanism that enables mutual verification and refinement of information\. This process includes two enhancement directions:*Graph\-to\-Text*and*Text\-to\-Graph*\.

#### 3\.3\.1Graph\-to\-Text Synergy

This process utilizes structured knowledge from the graph channel to guide the rediscovery and re\-ranking of text evidence, rather than relying only on surface\-level similarity to the query\.

1. 1\.Chunk Recommendation: We aggregate all entities visited during the Semantic Beam Search \(including those in pruned paths\) to form a global visited setEv​i​s​i​t​e​dE\_\{visited\}\. These entities act as ”recommenders” to ”vote” for their source text chunks\. The graph\-recommended chunks are merged withCi​n​i​t​i​a​lC\_\{initial\}to create a broader candidate poolCc​a​n​d​i​d​a​t​eC\_\{candidate\}, allowing text chunks that have low semantic similarity but are structurally relevant to be recalled\.
2. 2\.Chunk Re\-ranking: We calculate a recommendation scoreR​e​c​\(c\)Rec\(c\)for each text chunkc∈Cc​a​n​d​i​d​a​t​ec\\in C\_\{candidate\}, proportional to the number of entities recommending it\. The final scoreS​c​o​r​ef​i​n​a​l​\(c\)Score\_\{final\}\(c\)is a weighted fusion of its original semantic similarity and the graph recommendation score: S​c​o​r​efinal​\(c\)=\\displaystyle Score\_\{\\text\{final\}\}\(c\)=\\;α⋅Norm​\(sim​\(vq,vc\)\)\\displaystyle\\alpha\\cdot\\text\{Norm\}\\bigl\(\\text\{sim\}\(v\_\{q\},v\_\{c\}\)\\bigr\)\+\(1−α\)⋅Norm​\(Rec​\(c\)\)\\displaystyle\+\(1\-\\alpha\)\\cdot\\text\{Norm\}\\bigl\(\\text\{Rec\}\(c\)\\bigr\)\(2\)whereα\\alphais a hyperparameter balancing the two scores\.

Table 1:Main results on MuSiQue and HotpotQA datasets\. Retrieval performance is evaluated using Provenance Mapping\. Generation quality is evaluated by DeepSeek\-V3\.2 as a Judge\.
#### 3\.3\.2Text\-to\-Graph Synergy

This process utilizes the rich contextual information in the text channel to verify and enhance the structured paths discovered in the graph channel\. As illustrated in Figure[3](https://arxiv.org/html/2605.05643#S2.F3), this involves confirming existing paths and resurrecting pruned connections\.

For each pathp∈Pi​n​i​t​i​a​lp\\in P\_\{initial\}, we first calculate a base quality scoreS​c​o​r​eb​a​s​e​\(p\)Score\_\{base\}\(p\)based on the semantic similarity of its components to the queryqqand their structural importance\.

1. 1\.Path Confirmation: The path is validated by checking the intersection of entities on the path and entities contained inCi​n​i​t​i​a​lC\_\{initial\}\. If a path receives support from text evidence \(i\.e\., its entities appear in the retrieved text chunks\), its score is boosted: S​c​o​r​ec​o​n​f​\(p\)=S​c​o​r​eb​a​s​e​\(p\)\+ϵ⋅\|E​n​t​i​t​i​e​s​\(p\)∩E​n​t​i​t​i​e​s​\(Ci​n​i​t​i​a​l\)\|Score\_\{conf\}\(p\)=Score\_\{base\}\(p\)\\\\ \+\\epsilon\\cdot\|Entities\(p\)\\cap Entities\(C\_\{initial\}\)\|\(3\)whereϵ\\epsilonis the weight for text confirmation reward\.
2. 2\.Memory\-based Orphan Entity Bridging: To discover potential knowledge ignored by the initial path pruning, we defineOrphan EntitiesEo​r​p​h​a​nE\_\{orphan\}as key entities that are activated by the retrieved text evidenceCi​n​i​t​i​a​lC\_\{initial\}but are absent from the initially selected graph pathsPi​n​i​t​i​a​lP\_\{initial\}\. Instead of performing a costly new search or re\-expansion, we leverage theVisited Memoryas a*deferred reasoning buffer*\. If an orphan entity exists in the visited but pruned nodes, the original pruning decision is reversed by directly replaying its stored path, thereby resurrecting a valid reasoning chain without additional database queries\. We check if any orphan entity exists in the set of visited nodes that were pruned during the beam selection \(detailed procedure in Algorithm 2, Appendix B\)\. If found, the path leading to this orphan entity is ”resurrected” as a bridge pathpb​r​i​d​g​ep\_\{bridge\}\. This mechanism efficiently recovers logical connections that are semantically distant but contextually bridged by the text, without incurring additional database query overhead\.

### 3\.4Context Consolidation and Answer Generation

After precise scoring and ranking, the Top\-K pathsPT​o​p−KP\_\{Top\-K\}and text chunksCT​o​p−KC\_\{Top\-K\}are selected\. EachPT​o​p−KP\_\{Top\-K\}is formatted into clear natural language reasoning chains\. If supported bypb​r​i​d​g​ep\_\{bridge\}, these bridging paths are also appended as supporting metadata\. Finally, the consolidated context ofPT​o​p−KP\_\{Top\-K\}andCT​o​p−KC\_\{Top\-K\}, along with the original queryqq, is submitted to the LLM to generate a logically coherent and evidence\-grounded answer\.

## 4Experiments

In this section, we present a comprehensive evaluation of TGS\-RAG against state\-of\-the\-art retrieval paradigms\. We aim to validate the effectiveness of our bidirectional synergy mechanism in resolving the ”information island” problem inherent in multi\-hop reasoning tasks\.

### 4\.1Experimental Setup

#### 4\.1\.1Datasets

We utilize two widely recognized benchmarks for multi\-hop question answering:

- •MuSiQue\-AnsTrivediet al\.\([2022](https://arxiv.org/html/2605.05643#bib.bib8)\): A dataset characterized by connected reasoning chains \(typically 2\-4 hops\) and low lexical overlap between connected documents\. It serves as the primary testbed for our ”Orphan Entity Bridging” mechanism\.
- •HotpotQA \(Distractor\)Yanget al\.\([2018](https://arxiv.org/html/2605.05643#bib.bib9)\): A dataset requiring reasoning over two supporting documents amidst logically irrelevant but semantically similar distractor documents\.

#### 4\.1\.2Implementation Details

To ensure a robust and cost\-effective experimental environment, we employGPT\-4o\-minias the backbone LLM for all tasks, including Knowledge Graph construction, entity extraction, and final answer generation\. For semantic representation, we utilizeQwen3\-Embedding\-0\.6B\(Zhanget al\.,[2025](https://arxiv.org/html/2605.05643#bib.bib17)\)as the unified embedding model for all queries, text chunks, and graph entities\. For evaluation, we utilize DeepSeek\-V3\.2\(Liuet al\.,[2024](https://arxiv.org/html/2605.05643#bib.bib10)\)as an impartial LLM\-as\-a\-Judge\(Liet al\.,[2025](https://arxiv.org/html/2605.05643#bib.bib7)\)\(evaluation prompt provided in Appendix A\.4\)\. We instruct DeepSeek\-V3\.2 to evaluate semantic equivalence between the generated answer and the ground truth, accounting for valid aliases while penalizing hallucinations\.

Table 2:Efficiency and token usage analysis\. Detailed breakdown of token consumption across MuSiQue and HotpotQA datasets\. Grouping by dataset allows for a direct comparison of computational costs among different retrieval paradigms\.
#### 4\.1\.3Baselines

We compare TGS\-RAG with three categories of retrieval methods\. All baselines are implemented following their original configurations, utilizing identical LLM backbones \(GPT\-4o\-mini\) and consistent text chunking strategies to ensure a fair comparison\. Detailed implementation parameters and sensitivity analyses are provided in Appendix C and E\.

- •Naive RAG:Standard dense retrieval using vector similarity\.
- •Hybrid RAG \(Dense\+Sparse Text Retrieval\):A combination of dense vector retrieval and sparse keyword retrieval \(BM25/TF\-IDF\) fused via Reciprocal Rank Fusion \(RRF\)Cormacket al\.\([2009](https://arxiv.org/html/2605.05643#bib.bib18)\)\.
- •Graph\-centric Methods:We evaluate state\-of\-the\-art graph retrieval systems, includingGraphRAG\(Edgeet al\.,[2024](https://arxiv.org/html/2605.05643#bib.bib3)\)andLightRAG\(Guoet al\.,[2025](https://arxiv.org/html/2605.05643#bib.bib2)\)\. To rigorously benchmark the performance ceiling of each method, we employ their most comprehensive retrieval modes and include their associated textual evidence or community summaries where applicable: ”Local Search” for GraphRAG \(focusing on entity\-centric reasoning\) and ”Max” mode for LightRAG \(integrating both global and local signals\)\. Additionally, we compare againstK​G2​R​A​GKG^\{2\}RAG\(Zhuet al\.,[2025](https://arxiv.org/html/2605.05643#bib.bib1)\)as a representative of semantic\-to\-graph expansion paradigms\.

For methods with explicit text chunk retrieval, we fix the text chunk top\-kktok=5k=5\.

#### 4\.1\.4Evaluation Metrics

To rigorously assess both retrieval completeness and generation accuracy, we employ a multi\-dimensional metric system\.

##### Retrieval Scope with Provenance Mapping\.

Unlike standard RAG which only retrieves text chunks, TGS\-RAG retrieves both structured paths and unstructured chunks\. To ensure a fair comparison with document\-level ground truth, we define the set of retrieved documentsDr​e​tD\_\{ret\}as the union of explicit document retrieval and implicit graph provenance:

Dr​e​t=Dc​h​u​n​k​s∪\{d​o​c∣∃e∈Pg​r​a​p​h,d​o​c∈S​o​u​r​c​e​\(e\)\}D\_\{ret\}=D\_\{chunks\}\\cup\\\{doc\\mid\\exists e\\in P\_\{graph\},doc\\in Source\(e\)\\\}\(4\)whereDc​h​u​n​k​sD\_\{chunks\}denotes the source documents of the top\-kkretrieved text chunks, andS​o​u​r​c​e​\(e\)Source\(e\)represents the source documents of entities contained in the retrieved graph pathsPg​r​a​p​hP\_\{graph\}\. Based onDr​e​tD\_\{ret\}, we calculateStrict Hit Rate \(SHR\), the percentage of queries whereDr​e​tD\_\{ret\}containsallground truth supporting documents, andSupport F1, measuring the quality of evidence\. Because graph\-based retrieval expands evidence through entity\-to\-document provenance, its retrieved document set is typically broader than chunk\-only baselines, making Support F1 a conservative metric that may be lower despite stronger structural coverage\.

##### Generation Quality \(LLM\-as\-a\-Judge\)\.

Traditional string\-matching metrics \(e\.g\., Exact Match\) often penalize correct but verbose answers\. Therefore, we adoptLLM Judge Accuracy, employing DeepSeek\-V3\.2 to judge whether the generated response contains the correct information specified in the gold answer\.

### 4\.2Main Results

#### 4\.2\.1Performance Comparison

Table[1](https://arxiv.org/html/2605.05643#S3.T1)presents a comprehensive evaluation of retrieval and generation performance across MuSiQue and HotpotQA benchmarks\.

##### Limitations of Shallow Hybridization and Unidirectional Expansion\.

The results reveal critical bottlenecks in existing retrieval paradigms\. As observed in the MuSiQue dataset,Hybrid RAGyields a Strict Hit Rate \(14\.23%\) and Judge Accuracy \(21\.56%\) virtually identical to Naive RAG\. This stagnation confirms that the primary challenge in multi\-hop reasoning is not lexical mismatch—which keyword search addresses—butstructural disconnection\. Hybrid methods fail to bridge the gap when documents share no lexical overlap but are logically linked\. Similarly,K​G2​R​A​GKG^\{2\}RAGunderperforms significantly \(9\.10% Hit Rate on MuSiQue\), demonstrating the fragility of unidirectional ”semantic\-to\-graph” expansion; if the initial semantic retrieval misses key anchor points, the subsequent graph reasoning collapses due to the lack of a feedback loop\.

##### The Precision\-Recall Trade\-off in Graph Baselines\.

While heavy graph\-based approaches likeGraphRAGandLightRAGachieve competitive recall, they suffer from severe precision degradation\. On HotpotQA, both methods exhibit extremely low retrieval precision \(≈\\approx10%\), compared to 27\.41% for TGS\-RAG\. This indicates aninformation overloadphenomenon: these systems retrieve excessive, logically loosely related graph components \(e\.g\., entire communities\), which introduces significant noise into the context window\. Consequently, despite high recall, their generation accuracy \(LLM Judge\) is compromised by the distraction of irrelevant evidence\.

##### Superiority of TGS\-RAG\.

TGS\-RAGestablishes a new state\-of\-the\-art by effectively balancing retrieval scope and precision\. On MuSiQue, it achieves a Strict Hit Rate of34\.84%, more than doubling the performance of Hybrid RAG\. On HotpotQA, it attains the highest Strict Hit Rate, Recall, and Judge Accuracy, reaching a Judge Accuracy of79\.99%despite a conservative Support F1 of26\.06%under broader graph provenance\. Unlike baselines that trade precision for recall, TGS\-RAG utilizes the bidirectional synergy to filter out pseudo\-evidence while resurrecting subtle logical links, providing the LLM with a concise and rigorous reasoning chain\.

### 4\.3Efficiency Analysis

Table[2](https://arxiv.org/html/2605.05643#S4.T2)details the computational costs associated with each paradigm\. A comparative analysis highlights the superior cost\-effectiveness of our framework\.

##### Prohibitive Costs of Global Indexing\.

Graph\-based global indexing methods impose a prohibitive computational burden\.LightRAGandGraphRAGincur astronomical token usage \(e\.g\., over 757M tokens for LightRAG on HotpotQA vs\. 62M for Naive RAG\), primarily driven by the exhaustive construction of community summaries and dual\-level indices\. This massive overhead renders them impractical for dynamic or large\-scale knowledge bases where frequent updates are required\.

##### Optimal Pareto Frontier of TGS\-RAG\.

TGS\-RAG achieves an optimal trade\-off between performance and efficiency\. While it incurs a moderate cost increase over Naive RAG \(≈\\approx3x\) to support graph reasoning, it is drastically more efficient than global graph methods—consuming only37%of the tokens used by GraphRAG on MuSiQue and less than30%of LightRAG on HotpotQA\. This efficiency stems from our algorithmic design: instead of pre\-computing expensive global summaries, TGS\-RAG employs anon\-demandretrieval strategy\. TheSemantic Beam SearchandMemory\-based Orphan Entity Bridgingselectively explore and resurrect only contextually relevant paths during inference, avoiding the redundant processing of the entire graph structure\.

### 4\.4Ablation Study

To verify the contribution of each module in our bidirectional synergy mechanism, we conducted an ablation study on theHotpotQAdataset\. We developed two variants:

- •w/o Graph\-to\-Text \(Re\-ranking\):Disables theGlobal Votingmechanism\. Text chunks are ranked solely by vector similarity\.
- •w/o Text\-to\-Graph \(Bridging\):Disables theMemory\-based Orphan Entity Bridging\. The system relies solely on the initial graph paths found by beam search\.

Table 3:Ablation study on HotpotQA\. Detailed impact of removing synergy modules\.As shown in Table[3](https://arxiv.org/html/2605.05643#S4.T3), removing the Graph\-Guided Re\-ranking module leads to a decline in Strict Hit Rate to52\.65%and Support F1 to24\.08%\. This indicates that without structured filtering, the retriever struggles to distinguish between semantically similar distractors and true supporting facts, thereby reducing the precision and overall quality of the evidence context\. A concrete example of this ”Semantic Drift” and how our synergy mechanism resolves it is analyzed in Appendix D\.

Similarly, removing the Bridging module results in the most significant performance degradation, with Strict Hit Rate dropping sharply from62\.00%to47\.82%\. This confirms that standard graph traversal may fail when potentially valid evidence nodes are pruned early, whereas our memory\-based resurrection mechanism effectively recovers these ”orphan” connections\.

## 5Conclusion

We have proposedTGS\-RAG, a bidirectional text–graph synergistic framework designed to resolve the isolation between unstructured textual evidence and structured graph\-based reasoning\. By modeling retrieval as a collaborative process, TGS\-RAG effectively bridges the ”Information Island” gap inherent in multi\-hop reasoning tasks\.

The framework introduces two complementary enhancement channels:Graph\-Guided Re\-rankingleverages structured logic to filter semantic noise from text retrieval, whileMemory\-based Orphan Entity Bridgingutilizes textual context to validate and complete graph reasoning paths\. A critical innovation is the use of ”visited memory” toresurrectpruned paths, which recovers potentially useful logical links that were previously discarded during search, without the computational overhead of iterative expansion\.

Extensive experiments on MuSiQue and HotpotQA demonstrate that TGS\-RAG consistently outperforms strong text\-based, graph\-based, and hybrid baselines\. Our results indicate that shallow hybridization is insufficient; instead, effective multi\-hop reasoning requires structured and unstructured evidence to mutually verify and correct each other\. Notably, TGS\-RAG achieves this state\-of\-the\-art performance with significantly lower token consumption compared to global graph retrieval methods\. Overall, this work underscores the importance of bidirectional synergy and provides a scalable foundation for integrating symbolic structure with neural representations in LLMs\.

## Appendix APrompt Templates

To ensure reproducibility, we provide the core prompt templates used inTGS\-RAG\. All prompts are engineered to be concise and task\-specific for the underlying LLM \(GPT\-4o\-mini\)\.

### A\.1Entity & Relation Extraction Prompt

This prompt guides the LLM to extract structured knowledge triplets from unstructured text chunks during the Knowledge Base Construction phase\.

System Prompt: Knowledge Graph Specialist—Role— You are a Knowledge Graph Specialist responsible for extracting entities and relationships from the input text\.—Instructions—1\.Entity Extraction:Identify clearly defined and meaningful entities\.•Fields:–name: The name of the entity \(Title Case\)\.–type: Categorize the entity using the providedEntity\_types\. If none apply, classify asother\.–description: A concise description basedsolelyon the text\.•Target Format \(JSON Lines\): \{"type": "entity", "name": "\.\.\.", "category": "\.\.\.", "desc": "\.\.\."\}2\.Relationship Extraction:Identify direct binary relationships between previously extracted entities\.•Rule:Decompose complex N\-ary relationships into binary pairs\.•Fields:–source/target: The exact names of the source and target entities\.–keywords: Comma\-separated high\-level keywords summarizing the relation\.–description: A concise explanation of the connection\.•Target Format \(JSON Lines\): \{"type": "relation", "source": "\.\.\.", "target": "\.\.\.", "keywords": \["\.\.\."\], "desc": "\.\.\."\}3\.General Rules:•Output all entities first, followed by all relationships\.•Use third\-person perspective\. Avoid pronouns like ’I’, ’you’, ’this article’\.•The entire output must be in\{language\}\. Proper nouns should be retained in their original language\.•End Signal:Output the literal string<\|COMPLETE\|\>on the final line\.—Real Data to be Processed— ¡Input¿ Entity\_types:\[\{entity\_types\}\] Text: \{input\_text\}

### A\.2Query Entity Extraction Prompt

This prompt is used in the online retrieval stage\. To handle complex user intents and avoid keyword noise, we employ detailed exclusion rules and few\-shot demonstrations to guide the LLM in identifying the core search targets\.

User Prompt: Query Analysis—Role— You are a highly intelligent query analysis engine for a Retrieval\-Augmented Generation \(RAG\) system\.—Goal— Accurately identify and extract key concepts or entities that serve as thecore subjectsof the user’s query\.—Definition of Core Entity— A core entity is a noun or proper noun with clear referential meaning\. It usually belongs to:•Specific Objects:Person names, locations, organizations, models \(e\.g\., ”iPhone 15”\)\.•Abstract Concepts:Technical terms, theories, strategies \(e\.g\., ”RoHS directive”\)\.•Broad Themes:The central topic of vague queries \(e\.g\., extract ”marketing” from ”tell me about marketing”\)\.—Exclusion Criteria \(Do NOT Extract\)— 1\.User Intent Verbs:Words indicating what the user wants to do \(e\.g\., ”compare”, ”find”, ”list”, ”describe”\)\. 2\.Functional Words:Stop words or general nouns acting as sentence structures \(e\.g\., ”information”, ”detail”, ”introduction”\)\.—Few\-Shot Demonstrations—1\.User:”Help me introduce a fighter\.” Output:\["fighter"\]\(Ignore ”introduce”\)2\.User:”What is the relationship between RoHS and peak forward current?” Output:\["RoHS", "peak forward current"\]3\.User:”Hello, how are you?” Output:\[\]\(No core entities\)—Task— User Query:"\[User Query String\]" Extracted Entities \(JSON Format\):

### A\.3Final Answer Generation Prompt

This prompt synthesizes the retrieved graph paths and text chunks\. It includes strict instructions to prioritize evidence over prior knowledge and explicitly handle missing information to prevent hallucinations\.

User Prompt: Context Consolidation—Role— You are a knowledgeable and logically rigorous AI knowledge assistant\.—Core Instructions—1\.Strict Adherence to Context:Your answer must becompletelyandsolelybased on the provided evidence\. You arestrictly prohibitedfrom using internal prior knowledge\.2\.Synthesis & Reasoning:•UseKnowledge Graph Pathsto establish the logical backbone \(relationships between A and B\)\.•UseTextual Evidenceto fill in specific details \(dates, descriptions, attributes\)\.•If a logical link is provided in the graph but missing in the text \(or vice versa\), synthesize them to form a complete chain\.3\.Anti\-Hallucination:If the provided context does not contain sufficient information to answer the question, explicitly state:”Based on the provided materials, I cannot answer this question\.”4\.Structure:Organize the response clearly using headings, bullet points, or Markdown tables for comparisons\.—Context Provided— \#\# Knowledge Graph Paths \[Path 1: Entity A \-\-\(relation\)\-\-\> Entity B \-\-\(relation\)\-\-\> Entity C\] \[Path 2: \.\.\.\]\#\# Textual Evidence \[Evidence 1 \(Source: Doc A\): "\.\.\.specific content text\.\.\."\] \[Evidence 2: \.\.\.\]—Task— User’s Original Question:"\[User Query String\]" Your Answer:

### A\.4LLM\-as\-a\-Judge Evaluation Prompt

To evaluate generation quality, we adopt an LLM\-as\-a\-Judge paradigm to assess whether a generated answer contains the correct information specified by the gold answer\.

System Prompt: Answer Correctness JudgeYou are an impartial and strict judge evaluating the correctness of a generated answer compared to a gold standard answer\. Your task is to determine if the ”Generated Answer” contains the correct information specified in the ”Gold Answer”\.Rules:1\.Answer\-Centric Evaluation:Judge solely based on whether the core answer required by the Gold Answer is correctly provided\. Additional correct or irrelevant information should not affect the judgement unless it introduces contradictions\.2\.Semantic Equivalence:If the generated answer is verbose but clearly contains the correct core entity, fact, or conclusion, mark it asCORRECT\.3\.Aliases:Treat any provided aliases of the Gold Answer as equally valid correct answers\.4\.Hallucination or Contradiction:If the generated answer contains incorrect facts or conflicts with the Gold Answer, mark it asINCORRECT\.5\.Non\-Answering:If the generated answer states uncertainty or fails to provide the required answer, mark it asINCORRECT\.Output Format \(JSON\):``` { "is_correct": boolean, "reason": "Short explanation." } ```

## Appendix BAlgorithm Pseudocode

We present the pseudocode for the core algorithms ofTGS\-RAG: Semantic Beam Search \(which constructs the Visited Memory\) and Memory\-based Orphan Entity Bridging\.

Algorithm 1Semantic Beam Search with Visited Memory0:Query embedding

𝐪\\mathbf\{q\}, Seed Entities

Es​e​e​dE\_\{seed\}, Knowledge Graph

𝒢\\mathcal\{G\}, Beam Width

KK, Max Depth

DD
0:Top Paths

Pi​n​i​t​i​a​lP\_\{initial\}, Visited Memory

ℳv​i​s​i​t​e​d\\mathcal\{M\}\_\{visited\}
1:Initialize

Pc​u​r​r←\{\[e\]∣e∈Es​e​e​d\}P\_\{curr\}\\leftarrow\\\{\[e\]\\mid e\\in E\_\{seed\}\\\}
2:Initialize

ℳv​i​s​i​t​e​d←∅\\mathcal\{M\}\_\{visited\}\\leftarrow\\emptyset
3:foreach

e∈Es​e​e​de\\in E\_\{seed\}do

4:

ℳv​i​s​i​t​e​d​\[e\]←\{p​a​t​h:\[e\],s​c​o​r​e:1\.0\}\\mathcal\{M\}\_\{visited\}\[e\]\\leftarrow\\\{path:\[e\],score:1\.0\\\}\{Initialize memory with seeds\}

5:endfor

6:for

d=1d=1to

DDdo

7:

C​a​n​d​i​d​a​t​e​s←∅Candidates\\leftarrow\\emptyset
8:foreach path

p∈Pc​u​r​rp\\in P\_\{curr\}do

9:

ec​u​r​r←pl​a​s​te\_\{curr\}\\leftarrow p\_\{last\}\{Last node in path\}

10:

𝒩←𝒢\.GetNeighbors​\(ec​u​r​r\)\\mathcal\{N\}\\leftarrow\\mathcal\{G\}\.\\text\{GetNeighbors\}\(e\_\{curr\}\)\{Limit by edge weight if necessary\}

11:foreach neighbor

n∈𝒩n\\in\\mathcal\{N\}do

12:if

n∉pn\\notin pthen\{Cycle prevention\}

13:

𝐧←GetEmbedding​\(n\)\\mathbf\{n\}\\leftarrow\\text\{GetEmbedding\}\(n\)
14:

s​i​m←CosineSim​\(𝐧,𝐪\)sim\\leftarrow\\text\{CosineSim\}\(\\mathbf\{n\},\\mathbf\{q\}\)
15:

pn​e​w←p\+\[n\]p\_\{new\}\\leftarrow p\+\[n\]\{Key Step:Track all explored nodes and their paths in Memory\}

16:if

n∉ℳv​i​s​i​t​e​dn\\notin\\mathcal\{M\}\_\{visited\}or

s​i​m\>ℳv​i​s​i​t​e​d​\[n\]\.s​c​o​r​esim\>\\mathcal\{M\}\_\{visited\}\[n\]\.scorethen

17:

ℳv​i​s​i​t​e​d​\[n\]←\{p​a​t​h:pn​e​w,s​c​o​r​e:s​i​m\}\\mathcal\{M\}\_\{visited\}\[n\]\\leftarrow\\\{path:p\_\{new\},score:sim\\\}
18:endif

19:

C​a​n​d​i​d​a​t​e​s←C​a​n​d​i​d​a​t​e​s∪\{\(pn​e​w,s​i​m\)\}Candidates\\leftarrow Candidates\\cup\\\{\(p\_\{new\},sim\)\\\}
20:endif

21:endfor

22:endfor

23:

Pc​u​r​r←SelectTopK​\(C​a​n​d​i​d​a​t​e​s,K\)P\_\{curr\}\\leftarrow\\text\{SelectTopK\}\(Candidates,K\)\{Pruning step: keep only top\-K paths\}

24:endfor

25:return

Pc​u​r​r,ℳv​i​s​i​t​e​dP\_\{curr\},\\mathcal\{M\}\_\{visited\}

Algorithm 2Memory\-based Orphan Entity Bridging0:Retrieved Text Chunks

Ct​e​x​tC\_\{text\}, Visited Memory

ℳv​i​s​i​t​e​d\\mathcal\{M\}\_\{visited\}, Initial Graph Paths

Pi​n​i​t​i​a​lP\_\{initial\}
0:Final Path Set

Pf​i​n​a​lP\_\{final\}
1:

Et​e​x​t←ExtractEntityIds​\(Ct​e​x​t\)E\_\{text\}\\leftarrow\\text\{ExtractEntityIds\}\(C\_\{text\}\)
2:

Eg​r​a​p​h←⋃p∈Pi​n​i​t​i​a​l\{e∣e∈p\}E\_\{graph\}\\leftarrow\\bigcup\_\{p\\in P\_\{initial\}\}\\\{e\\mid e\\in p\\\}
3:

Eo​r​p​h​a​n←Et​e​x​t∖Eg​r​a​p​hE\_\{orphan\}\\leftarrow E\_\{text\}\\setminus E\_\{graph\}\{Identify entities present in text but missing from graph paths\}

4:

Pb​r​i​d​g​e←∅P\_\{bridge\}\\leftarrow\\emptyset
5:foreach orphan entity

e∈Eo​r​p​h​a​ne\\in E\_\{orphan\}do

6:if

e∈ℳv​i​s​i​t​e​de\\in\\mathcal\{M\}\_\{visited\}then

7:

pr​e​c​o​v​e​r​e​d←ℳv​i​s​i​t​e​d​\[e\]\.p​a​t​hp\_\{recovered\}\\leftarrow\\mathcal\{M\}\_\{visited\}\[e\]\.path\{Zero\-overhead bridging: Resurrect path from memory\}

8:

Pb​r​i​d​g​e←Pb​r​i​d​g​e∪\{pr​e​c​o​v​e​r​e​d\}P\_\{bridge\}\\leftarrow P\_\{bridge\}\\cup\\\{p\_\{recovered\}\\\}
9:endif

10:endfor

11:

Pf​i​n​a​l←Pi​n​i​t​i​a​l∪Pb​r​i​d​g​eP\_\{final\}\\leftarrow P\_\{initial\}\\cup P\_\{bridge\}
12:return

Pf​i​n​a​lP\_\{final\}

## Appendix CImplementation Details

This section provides implementation details of TGS\-RAG to ensure reproducibility, including hyperparameter settings, model choices, and system configuration\. All parameters reported here correspond to the best\-performing configuration identified through the sensitivity analysis described in Appendix[E](https://arxiv.org/html/2605.05643#A5)\.

### C\.1Hyperparameters

Table[4](https://arxiv.org/html/2605.05643#A3.T4)summarizes the hyperparameters used in all experiments unless otherwise specified\. These parameters govern the bidirectional synergy between text and graph retrieval, including semantic–structural balancing, graph search behavior, and memory\-based orphan entity bridging\.

Table 4:Hyperparameter Settings for TGS\-RAGThe chunk synergy weightα\\alphacontrols the balance between semantic similarity and graph\-based recommendation during text re\-ranking, while the text confirmation bonusϵ\\epsilondetermines the strength of textual evidence in validating graph paths\. The remaining parameters primarily affect search efficiency and structural bias and are shown to have limited sensitivity within reasonable ranges\.

### C\.2Environment and Models

- •Large Language Model \(LLM\):GPT\-4o\-mini is used for all LLM\-invoked components, including entity extraction, knowledge graph construction, and final answer generation\.
- •Embedding Model:We employ theQwen3\-Embedding\-0\.6Bmodel with an output dimension of 1024 for encoding queries, text chunks, and graph entities\.
- •Database:All text chunks, graph entities, relations, and their embeddings are stored in PostgreSQL with thepgvectorextension, enabling unified vector\-based retrieval over both structured and unstructured data\.
- •Execution Environment:Experiments are conducted on a standard Linux server with 32GB RAM\. No GPU acceleration is required, as all model inference is performed via API\-based services\.

### C\.3Reproducibility Notes

To ensure reproducibility and stable evaluation:

- •All entity extraction results from user queries are cached to eliminate stochastic variation from repeated LLM calls\.
- •Hyperparameter tuning is conducted on a dynamically balanced validation subset of MuSiQue, with deterministic sampling to guarantee consistent comparisons across configurations\.
- •All reported results use the same fixed hyperparameter configuration identified as optimal in the sensitivity analysis\.

## Appendix DCase Study: Overcoming Semantic Drift

To intuitively demonstrate the effectiveness of our bidirectional synergy, we analyze a representative multi\-hop query from the MuSiQue dataset where baseline methods failed due to semantic ambiguity\.

Case Study: Semantic Drift vs\. Structural BridgingQuery:”Which actress had roles in the movies ’Janie Jones’ and ’Signs’?”Baseline \(w/o Synergy\):•Retrieved Text:Chunks related to”Caro Jones”,”Shirley Jones”, and”Madison Jones”\.•Failure Cause:The vector retriever was misled by the high semantic density of the token ”Jones,” resulting inSemantic Drift\. It retrieved entities sharing the surname but lacking logical connection to the movie ”Signs”\.•Outcome:”Cannot Answer” \(Precision: 0\.00\)\.TGS\-RAG \(Ours\):•Graph Path Discovery:Janie Jones→c​a​s​t\\xrightarrow\{cast\}Abigail Breslin←c​a​s​t\\xleftarrow\{cast\}Signs•Mechanism:Although the text chunk for ”Abigail Breslin” initially had a lower semantic score than ”Caro Jones”, theGraph Channelidentified her as acommon neighbor\(bridge node\) connecting both query entities\.•Synergy:TheGraph\-Guided Re\-rankingmodule boosted the priority of the ”Abigail Breslin” chunk, suppressing the irrelevant ”Jones” family chunks\.•Outcome:Correct Answer: ”Abigail Breslin” \(Recall: 1\.00\)\.Figure 4:Qualitative comparison on a multi\-hop query\.While the baseline suffers from semantic drift \(focusing on the surname ”Jones”\), TGS\-RAG leverages the graph structure to identify the true bridge entity \(”Abigail Breslin”\) that logically connects the two distinct movies, effectively correcting the retrieval focus\.As shown in Figure[4](https://arxiv.org/html/2605.05643#A4.F4), the baseline method falls into the ”keyword trap,” retrieving semantically similar but logically irrelevant entities \(various people named ”Jones”\)\. In contrast, TGS\-RAG successfully bridges the logical gap\. TheSemantic Beam Searchdiscovered that ”Abigail Breslin” is the structural intersection of the two movies\. Crucially, this structural signal allowed the system to ”resurrect” the correct textual evidence that was otherwise buried by the vector retriever, validating the necessity of our graph\-guided re\-ranking mechanism\.

## Appendix EHyperparameter Sensitivity Analysis

We analyze the sensitivity of TGS\-RAG to key hyperparameters that govern the bidirectional synergy between text and graph retrieval\. All experiments are conducted on a dynamically balanced validation subset of MuSiQue, and performance is measured using Strict Hit Rate\.

##### Effect of Chunk Synergy Weightα\\alpha\.

Varying the chunk synergy weightα\\alphaexhibits a clear unimodal trend\. Performance improves asα\\alphaincreases from 0\.4 to 0\.5 and degrades for larger values\. This behavior reflects the trade\-off between semantic similarity and graph\-based structural guidance: smallerα\\alphaunderweights structural signals, while largerα\\alphaoveremphasizes graph recommendations at the expense of semantic relevance\. The variance across runs is consistently small, indicating stable behavior around the optimal region\.

##### Effect of Text Confirmation Bonusϵ\\epsilon\.

The text confirmation bonusϵ\\epsilonshows a threshold\-and\-saturation pattern\. Performance remains largely unchanged for small values ofϵ\\epsilonand peaks aroundϵ=0\.4\\epsilon=0\.4, after which further increases yield no additional benefit\. This confirms that textual evidence is most effective when used for validating graph paths rather than aggressively promoting them\.

##### Beam Width and Search Depth\.

TGS\-RAG demonstrates robustness to moderate variations in beam widthKKand search depthdd\. Increasing the search depth fromd=3d=3tod=4d=4yields no observable improvement in retrieval performance, suggesting diminishing returns from deeper exploration\. This robustness indicates that the proposed memory\-based orphan entity bridging mechanism effectively recovers potentially valid reasoning chains discarded during search\-time pruning\.

##### Pairwise Sensitivity ofα\\alphaandϵ\\epsilon\.

We further analyze the joint effect ofα\\alphaandϵ\\epsilonto assess parameter interaction stability\. Results show that the optimal configuration \(α=0\.5\\alpha=0\.5,ϵ=0\.4\\epsilon=0\.4\) is not an isolated point: neighboring combinations yield comparable performance with smooth degradation away from the optimum\. This indicates that TGS\-RAG does not rely on fragile parameter coupling and that its performance is stable across a contiguous region of the hyperparameter space\.

Overall, the selected configuration \(α=0\.5\\alpha=0\.5,ϵ=0\.4\\epsilon=0\.4,K=20K=20,d=3d=3\) achieves a favorable balance between effectiveness and efficiency and is used throughout all experiments\.

## References

- G\. V\. Cormack, C\. L\. A\. Clarke, and S\. Buettcher \(2009\)Reciprocal rank fusion outperforms condorcet and individual rank learning methods\.InProceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval,SIGIR ’09,New York, NY, USA,pp\. 758–759\.External Links:ISBN 9781605584836,[Link](https://doi.org/10.1145/1571941.1572114),[Document](https://dx.doi.org/10.1145/1571941.1572114)Cited by:[2nd item](https://arxiv.org/html/2605.05643#S4.I2.i2.p1.1)\.
- M\. Cossio \(2025\)A comprehensive taxonomy of hallucinations in large language models\.http://arxiv\.org/abs/2508\.01781\.Cited by:[§1](https://arxiv.org/html/2605.05643#S1.p2.1)\.
- D\. Edge, H\. Trinh, N\. Cheng, J\. Bradley, A\. Chao, A\. Mody, S\. Truitt, D\. Metropolitansky, R\. O\. Ness, and J\. Larson \(2024\)From local to global: a graph rag approach to query\-focused summarization\.arXiv preprint arXiv:2404\.16130\.Cited by:[§2\.2](https://arxiv.org/html/2605.05643#S2.SS2.p1.1),[3rd item](https://arxiv.org/html/2605.05643#S4.I2.i3.p1.1)\.
- Z\. Guo, L\. Xia, Y\. Yu, T\. Ao, and C\. Huang \(2025\)LightRAG: simple and fast retrieval\-augmented generation\.InFindings of the Association for Computational Linguistics: EMNLP 2025,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 10746–10761\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.568/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.568),ISBN 979\-8\-89176\-335\-7Cited by:[§2\.2](https://arxiv.org/html/2605.05643#S2.SS2.p1.1),[3rd item](https://arxiv.org/html/2605.05643#S4.I2.i3.p1.1)\.
- X\. He, Y\. Tian, Y\. Sun, N\. V\. Chawla, T\. Laurent, Y\. LeCun, X\. Bresson, and B\. Hooi \(2024\)G\-retriever: retrieval\-augmented generation for textual graph understanding and question answering\.InAdvances in Neural Information Processing Systems,A\. Globerson, L\. Mackey, D\. Belgrave, A\. Fan, U\. Paquet, J\. Tomczak, and C\. Zhang \(Eds\.\),Vol\.37,pp\. 132876–132907\.External Links:[Document](https://dx.doi.org/10.52202/079017-4224),[Link](https://proceedings.neurips.cc/paper_files/paper/2024/file/efaf1c9726648c8ba363a5c927440529-Paper-Conference.pdf)Cited by:[§2\.2](https://arxiv.org/html/2605.05643#S2.SS2.p1.1)\.
- Z\. Ji, N\. Lee, R\. Frieske, T\. Yu, D\. Su, Y\. Xu, E\. Ishii, Y\. J\. Bang, A\. Madotto, and P\. Fung \(2023\)Survey of hallucination in natural language generation\.ACM Comput\. Surv\.55\(12\)\.External Links:ISSN 0360\-0300,[Link](https://doi.org/10.1145/3571730),[Document](https://dx.doi.org/10.1145/3571730)Cited by:[§1](https://arxiv.org/html/2605.05643#S1.p1.1)\.
- V\. Karpukhin, B\. Oguz, S\. Min, P\. Lewis, L\. Wu, S\. Edunov, D\. Chen, and W\. Yih \(2020\)Dense passage retrieval for open\-domain question answering\.InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),B\. Webber, T\. Cohn, Y\. He, and Y\. Liu \(Eds\.\),Online,pp\. 6769–6781\.External Links:[Link](https://aclanthology.org/2020.emnlp-main.550/),[Document](https://dx.doi.org/10.18653/v1/2020.emnlp-main.550)Cited by:[§2\.1](https://arxiv.org/html/2605.05643#S2.SS1.p1.1)\.
- O\. Khattab and M\. Zaharia \(2020\)Colbert: efficient and effective passage search via contextualized late interaction over bert\.InProceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval,pp\. 39–48\.Cited by:[§2\.1](https://arxiv.org/html/2605.05643#S2.SS1.p1.1)\.
- P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel, S\. Riedel, and D\. Kiela \(2020\)Retrieval\-augmented generation for knowledge\-intensive nlp tasks\.InAdvances in Neural Information Processing Systems,H\. Larochelle, M\. Ranzato, R\. Hadsell, M\.F\. Balcan, and H\. Lin \(Eds\.\),Vol\.33,pp\. 9459–9474\.External Links:[Link](https://proceedings.neurips.cc/paper_files/paper/2020/file/6b493230205f780e1bc26945df7481e5-Paper.pdf)Cited by:[§1](https://arxiv.org/html/2605.05643#S1.p1.1)\.
- D\. Li, B\. Jiang, L\. Huang, A\. Beigi, C\. Zhao, Z\. Tan, A\. Bhattacharjee, Y\. Jiang, C\. Chen, T\. Wu,et al\.\(2025\)From generation to judgment: opportunities and challenges of llm\-as\-a\-judge\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,pp\. 2757–2791\.Cited by:[§4\.1\.2](https://arxiv.org/html/2605.05643#S4.SS1.SSS2.p1.1)\.
- A\. Liu, B\. Feng, B\. Xue, B\. Wang, B\. Wu, C\. Lu, C\. Zhao, C\. Deng, C\. Zhang, C\. Ruan,et al\.\(2024\)Deepseek\-v3 technical report\.arXiv preprint arXiv:2412\.19437\.Cited by:[§4\.1\.2](https://arxiv.org/html/2605.05643#S4.SS1.SSS2.p1.1)\.
- S\. Ma, C\. Xu, X\. Jiang, M\. Li, H\. Qu, C\. Yang, J\. Mao, and J\. Guo \(2025\)Think\-on\-graph 2\.0: deep and faithful large language model reasoning with knowledge\-guided retrieval augmented generation\.InInternational Conference on Representation Learning,Y\. Yue, A\. Garg, N\. Peng, F\. Sha, and R\. Yu \(Eds\.\),Vol\.2025,pp\. 52782–52806\.External Links:[Link](https://proceedings.iclr.cc/paper_files/paper/2025/file/830b1abc6d2da85f23d41169fa44d185-Paper-Conference.pdf)Cited by:[§2\.3](https://arxiv.org/html/2605.05643#S2.SS3.p2.1)\.
- J\. Sun, C\. Xu, L\. Tang, S\. Wang, C\. Lin, Y\. Gong, L\. Ni, H\. Shum, and J\. Guo \(2024\)Think\-on\-graph: deep and responsible reasoning of large language model on knowledge graph\.InThe Twelfth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=nnVO1PvbTv)Cited by:[§2\.2](https://arxiv.org/html/2605.05643#S2.SS2.p1.1)\.
- H\. Trivedi, N\. Balasubramanian, T\. Khot, and A\. Sabharwal \(2022\)MuSiQue: multihop questions via single\-hop question composition\.Transactions of the Association for Computational Linguistics\.Cited by:[1st item](https://arxiv.org/html/2605.05643#S4.I1.i1.p1.1)\.
- Z\. Yang, P\. Qi, S\. Zhang, Y\. Bengio, W\. Cohen, R\. Salakhutdinov, and C\. D\. Manning \(2018\)HotpotQA: a dataset for diverse, explainable multi\-hop question answering\.InProceedings of the 2018 Conference on Empirical Methods in Natural Language Processing,E\. Riloff, D\. Chiang, J\. Hockenmaier, and J\. Tsujii \(Eds\.\),Brussels, Belgium,pp\. 2369–2380\.External Links:[Link](https://aclanthology.org/D18-1259/),[Document](https://dx.doi.org/10.18653/v1/D18-1259)Cited by:[2nd item](https://arxiv.org/html/2605.05643#S4.I1.i2.p1.1)\.
- Y\. Zhang, M\. Li, D\. Long, X\. Zhang, H\. Lin, B\. Yang, P\. Xie, A\. Yang, D\. Liu, J\. Lin, F\. Huang, and J\. Zhou \(2025\)Qwen3 embedding: advancing text embedding and reranking through foundation models\.External Links:2506\.05176,[Link](https://arxiv.org/abs/2506.05176)Cited by:[§4\.1\.2](https://arxiv.org/html/2605.05643#S4.SS1.SSS2.p1.1.2)\.
- X\. Zhu, Y\. Xie, Y\. Liu, Y\. Li, and W\. Hu \(2025\)Knowledge graph\-guided retrieval augmented generation\.InNAACL,Cited by:[§2\.3](https://arxiv.org/html/2605.05643#S2.SS3.p1.1),[3rd item](https://arxiv.org/html/2605.05643#S4.I2.i3.p1.1)\.

Similar Articles

Why Retrieval-Augmented Generation Fails: A Graph Perspective

arXiv cs.CL

This paper investigates why Retrieval-Augmented Generation (RAG) systems fail despite having access to correct evidence. Using circuit tracing and attribution graphs, the authors find that correct predictions exhibit deeper reasoning paths and more distributed evidence flow, while failures show shallow and fragmented patterns. They propose a graph-based error detection framework and targeted interventions to improve RAG reliability.

GRACE-RAG: Governed Retrieval Architecture for Canonical Evidence Synthesis, Enabling Lightweight Deployment in Closed-Domain Institutional Settings

arXiv cs.AI

This paper introduces GRACE-RAG, a retrieval-governed, graph-augmented RAG architecture that externalizes structural reasoning from generation to a structured retrieval layer, enabling lightweight deployment in closed-domain institutional settings. Experiments show up to 20% quality gains with mid-scale models, reducing computational and latency footprint.

CMT-RAG: Complementary Memory Traces for Multi-turn Multi-hop RAG

arXiv cs.CL

Introduces CMT-RAG, a complementary memory framework for multi-turn multi-hop conversational RAG that aligns conversational memory with retrieval using sub-question-level reasoning traces. Also presents MuMu-QA, a benchmark with cross-turn sub-question dependencies.