HyCE-RAG: Hypergraph Chain-of-Evidence Retrieval-Augmented Generation for Explainable Multi-hop Question Answering
Summary
HyCE-RAG is a novel hypergraph-based retrieval-augmented generation framework for multi-hop question answering that constructs explicit evidence chains via confidence-aware heuristic search, outperforming standard RAG and graph-based RAG methods in accuracy, relevance, and faithfulness.
View Cached Full Text
Cached at: 07/28/26, 06:25 AM
# HyCE-RAG: Hypergraph Chain-of-Evidence Retrieval-Augmented Generation for Explainable Multi-hop Question Answering
Source: [https://arxiv.org/html/2607.22597](https://arxiv.org/html/2607.22597)
\\cortext
\[cor1\]Corresponding author\.
Yun\-Jian Zhang\[zhangyunjian@kaihong\.com\]\(mailto:zhangyunjian@kaihong\.com\)Chen\-Wei Liang\[z5537371@ad\.unsw\.edu\.au\]\(mailto:z5537371@ad\.unsw\.edu\.au\)Tian\-Yi Zhang\[tianyizhang0213@zju\.edu\.cn\]\(mailto:tianyizhang0213@zju\.edu\.cn\)Jian Ding\[dj19@tsinghua\.org\.cn\]\(mailto:dj19@tsinghua\.org\.cn\)Yi\-Lun Wu\[wuyilun@kaihong\.com\]\(mailto:wuyilun@kaihong\.com\)Ao\-Bo Li\[Liaobo@kaihong\.com\]\(mailto:Liaobo@kaihong\.com\)Wei\-Cong Su\[suweicong@kaihong\.com\]\(mailto:suweicong@kaihong\.com\)Saifullah\[saifullah@kaihong\.com\]\(mailto:saifullah@kaihong\.com\)Mujiangshan Wang\[mjs\.wang@siat\.ac\.cn\]\(mailto:mjs\.wang@siat\.ac\.cn\)State Key Laboratory of Internet of Things for Smart City \(SKL\-IoTSC\), University of Macau, MacauShenzhen Kaihong Digital Industry Development Co\., Ltd\., Shenzhen 518000, ChinaSchool of Mathematics and Statistics, Faculty of Science, University of New South Wales,Sydney, NSW 2052, AustraliaCollege of Computer Science and Technology, Zhejiang University, 38 Zheda Road, Hangzhou 310027, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
###### Abstract
Multi hop question answering requires models to retrieve relevant information from multiple documents and connect scattered evidence into a coherent reasoning process\. Traditional RAG methods mainly rely on semantic similarity based retrieval, which often fails to capture complex structural relations among entities and evidence units\. Graph based RAG alleviates this limitation by introducing graph structured knowledge, but pairwise relations are still insufficient for representing higher order associations involving multiple entities, facts, and contexts\. Recent hypergraph based RAG methods further improve knowledge representation through hypergraphs, yet they mainly focus on retrieval and structural representation, while explicit evidence chain construction and post retrieval reasoning remain underexplored
To address this problem, we develop HyCE\-RAG, namely Hypergraph Chain of Evidence Retrieval Augmented Generation, an evidence chain aware hypergraph reasoning framework for multi hop question answering\. Built upon hypergraph structured knowledge representation, HyCE\-RAG organizes entities, relations, and contextual evidence into hyperedges, and performs confidence aware heuristic search to select, connect, and rank relevant evidence\. The search process jointly considers semantic relevance, entity connectivity, evidence coverage, reasoning coherence, and propagated confidence scores\. By constructing explicit evidence chains before generation, HyCE\-RAG provides large language models with more structured and interpretable reasoning context\. Experiments on a recent GraphRAG benchmark and several widely used question answering datasets show that HyCE\-RAG outperforms standard RAG and existing graph based RAG methods in answer accuracy, context relevance, and faithfulness\. These results suggest that HyCE\-RAG offers a promising direction for the post retrieval stage of RAG, shifting it from simple context aggregation toward structured evidence reasoning\.
###### keywords:
Multi\-hop Question Answering\\sepRetrieval\-Augmented Generation\\sepHypergraph Reasoning\\sepKnowledge Hypergraph\\sepLarge Language Models\\sepExplainable Artificial Intelligence
## 1Introduction
Retrieval Augmented Generation \(RAG\) has emerged as a prominent paradigm for augmenting large language models \(LLM\) with external and continuously updated knowledge, thereby mitigating knowledge staleness and factual hallucination\[DBLP:journals/corr/abs\-2002\-08909,DBLP:journals/corr/abs\-2312\-10997\]\. Most standard RAG methods adopt a retrieval paradigm based on text chunks, where documents are segmented into passages and retrieved through dense vector similarity\. Although this approach is effective for retrieving locally relevant contexts, it often fails to capture the semantic structures among entities, relations, and evidence units\[zhao2026survey\]\.
This limitation becomes particularly critical in complex question answering scenarios\. First, semantic similarity does not necessarily imply factual utility\[asai2024self\]\. A retrieved passage may be topically related to the query, yet lack the evidence or reasoning premises required to derive the correct answer\. Second, for compositional questions that require multiple reasoning steps, the necessary evidence is often scattered across different chunks or documents\[yang2018hotpotqa,trivedi2023interleaving\]\. Since conventional RAG treats these chunks as independent context units\[lewis2020retrieval,karpukhin2020dense\], it lacks an explicit mechanism to model dependencies across chunks, connect dispersed evidence, and construct coherent reasoning paths\. Consequently, its effectiveness is limited in tasks requiring structured evidence integration and explainable reasoning\[jiang2023active\]\.
![[Uncaptioned image]](https://arxiv.org/html/2607.22597v1/images/figure0.drawio.png)
Figure 1:Cverview of the proposed HyCE\-RAG framework\. It constructs a query\-aware hypergraph from input questionqq, extracts confidence\-guided evidence chains, and produces a structured answer\.
To mitigate these limitations, recent studies have introduced graph\-structured knowledge into RAG systems\. GraphRAG\[edge2024local\]represents entities as nodes and relations as edges, which helps organize retrieved knowledge and support knowledge\-aware generation\[pan2024unifying\]\. However, conventional graph structures mainly model pairwise relations and are limited in capturing higher\-order semantic associations among multiple entities, relations, and evidence units\. This limitation is important for multi\-hop question answering, where a single supporting paragraph may jointly connect several entities, relations, and answer\-indicative facts\. Encoding such evidence only as independent pairwise edges may fragment the original semantic unit and introduce spurious reasoning paths when distractor entities are present\.
To address this issue, HyperGraphRAG\[luo2026hypergraphrag\]was proposed to construct hypergraph\-structured knowledge representations, where hyperedges can connect multiple entities or evidence units simultaneously\. Prior hypergraph\-based retrieval studies have shown that such high\-order structures are useful for modeling complex evidence dependencies in retrieval\-augmented generation\. However, these methods largely emphasize the construction and utilization of hypergraph representations, without explicitly analyzing how retrieved evidence contributes to the final answer\. As a result, they still provide limited interpretability for post\-retrieval reasoning, especially when multiple supporting and distracting evidence units are mixed together\.
Motivated by these observations, we develop HyCE\-RAG, namely Hypergraph Chain\-of\-Evidence Retrieval\-Augmented Generation, an evidence\-chain\-aware hypergraph reasoning framework for explainable multi\-hop question answering\. We do not aim to re\-establish the general advantage of hypergraphs over pairwise graphs, which has been investigated in prior hypergraph\-based retrieval work\. Instead, HyCE\-RAG focuses on how confidence can be propagated and organized over a query\-aware hypergraph to form faithful evidence chains for answer generation\.
Unlike conventional RAG, which directly feeds retrieved text chunks into the LLM, and GraphRAG, which typically retrieves query\-related nodes, edges, or subgraphs from a knowledge graph as supporting context, HyCE\-RAG converts retrieved documents into a hypergraph\-based evidence structure\. In this structure, hyperedges connect multiple related entities and evidence units, enabling the representation of higher\-order associations beyond pairwise relations\. Based on this structure, HyCE\-RAG performs confidence\-aware heuristic search by jointly considering semantic relevance, entity connectivity, evidence coverage, reasoning coherence, and propagated confidence scores\. The selected evidence is then organized into explicit evidence chains that link the question, intermediate evidence, and answer\-supporting context, and these chains are provided to the LLM as structured reasoning input\. Thereby, HyCE\-RAG extends hypergraph\-based RAG from knowledge representation to post\-retrieval evidence organization and reasoning\.
The main contributions of this work are summarized as follows:
- •We propose HyCE\-RAG, Hypergraph Chain\-of\-Evidence Retrieval\-Augmented Generation, a hypergraph\-based retrieval\-augmented generation framework for explainable multi\-hop question answering\. Building on the high\-order modeling capability of hypergraphs, HyCE\-RAG represents entities, relations, and evidence units in a corpus\-level hypergraph, enabling question\-aware evidence retrieval and structured evidence organization\.
- •We introduce a confidence propagation mechanism over the query\-aware hypergraph\. By propagating query relevance through entity–hyperedge incidence relations, HyCE\-RAG identifies not only initially retrieved entry entities but also structurally connected and question\-relevant entities that are important for multi\-hop reasoning\.
- •We develop a confidence\-guided evidence assembly and scoring strategy that organizes retrieved hyperedges, entities, and directed relations into compact evidence paths\. The scoring scheme jointly considers semantic relevance, entity coverage, relation reliability, and propagated confidence, allowing HyCE\-RAG to select more reliable and interpretable evidence for downstream answer generation\.
The remainder of this paper is organized as follows\. Section 2 reviews related work\. Section 3 introduces the HyCE\-RAG framework and its main components\. Section 4 presents the experimental results and discussion\. Section 5 concludes the paper\.
## 2Related Work
### 2\.1Retrieval\-Augmented Generation
Retrieval\-Augmented Generation \(RAG\) enhances LLMs by retrieving external knowledge and conditioning generation on the retrieved contexts\[arslan2024survey\]\. Most existing RAG systems rely on dense retrieval, where documents are segmented into passages or chunks and ranked according to their semantic similarity to the query\[gupta2024comprehensive\]\. This paradigm provides LLMs with access to external and query\-relevant knowledge, thereby alleviating the limitations of relying solely on parametric memory\.
Despite its effectiveness, standard RAG often treats retrieved chunks as independent and flat textual units\[zeeshan2025rag\]\. Most RAG methods treat retrieved chunks as independent and flat textual contexts by statically splitting documents, which completely disrupts the inherent relations among contiguous textual units\. As a result, retrieved contexts are often presented to the LLM as loosely organized textual fragments, making it difficult to capture entity\-level dependencies, connect dispersed evidence, and form coherent reasoning paths\. This issue is especially critical in complex question answering, where deriving the correct answer often requires integrating multiple pieces of evidence distributed across different documents\[jiang2025retrieve\]\. These challenges have motivated structure\-aware RAG methods that explicitly model relations among retrieved evidence\.
### 2\.2Graph\-Based and Hypergraph\-Based RAG
To overcome the limitations of flat chunk retrieval, graph based RAG methods introduce structured knowledge representations into the retrieval and generation process\[xiang2025use\]\. Instead of retrieving isolated text chunks, these methods extract entities and relations from documents to construct knowledge graphs or other graph\-structured indexes, and then retrieve query\-related nodes, edges, subgraphs, or community summaries as generation contexts\[zhu2025knowledge\]\. By organizing knowledge through explicit graph structures, RAG based on knowledge graphs can better capture entity\-level relations and provide more structured contexts for LLMs\. The use of graph structures for modeling complex connectivity, orientation, diagnosability, and fault\-tolerant information transmission has a long tradition in graph theory and network science\[mu2010ordered,zhao2017algorithm,wang2016diagnosability,wang2018edge,wang2011embedding\]\. Representative approaches in this direction include GraphRAG\[edge2024local\], which constructs entity\-centric graphs with community summaries to support both global and local retrieval; LightRAG\[guo2024lightrag\], which enhances retrieval efficiency via lightweight graph indexing; and GFM\-RAG\[luo2026gfm\], which further investigates the application of graph foundation models to retrieval\-augmented generation\. Beyond retrieval\-specific methods, LLMs have also been leveraged to enhance knowledge graph completion\[xu2024multi\], highlighting the broader potential of LLMs in improving graph\-based knowledge structures\. Recent graph learning studies further show that graph neural and attention\-based models can capture non\-stationary, relational, and spatio\-temporal dependencies in complex systems\[wei2025fstgat\], which is consistent with the motivation of using structured evidence dependencies in graph\-based and hypergraph\-based RAG\.
![[Uncaptioned image]](https://arxiv.org/html/2607.22597v1/images/figure1.drawio.png)
Figure 2:Conceptual comparison among Naive RAG, GraphRAG, and HyCE\-RAG\. HyCE\-RAG constructs confidence\-guided evidence chains over hypergraph representations for structured post\-retrieval reasoning\.
However, conventional graphs mainly represent pairwise relations between entities, which may be insufficient for complex reasoning scenarios where multiple entities, events, relations, or evidence units jointly support the answer\. In multi\-hop question answering, a supporting paragraph often connects several entities and facts at the same time\. Representing such evidence only as independent pairwise edges may fragment the original semantic unit and introduce noisy or spurious reasoning paths, especially when distractor contexts contain lexically related entities\.
To address this limitation, Luo et al\.\[luo2026hypergraphrag\]introduced HyperGraph\-RAG, a pioneering hypergraph\-based RAG framework that uses hyperedges to connect multiple related units simultaneously\. Compared with ordinary graph structures, hypergraphs provide a more expressive representation for modeling higher\-order associations among entities, relations, and evidence units\. Prior hypergraph\-based retrieval studies suggest that high\-order structures are beneficial for organizing complex evidence dependencies in retrieval\-augmented generation\.
Nevertheless, existing graph\-based and hypergraph\-based RAG methods primarily emphasize knowledge organization and retrieval, but provide limited support for explaining how the retrieved evidence is connected, weighted, and used to derive the final answer\. This limitation is especially critical in multi\-hop question answering, where models must integrate scattered evidence across multiple contexts, assess competing evidence, and form a coherent reasoning chain\[yang2018hotpotqa,ho2020constructing\]\.
### 2\.3Multi\-Hop Evidence Retrieval and Reasoning
Multi\-hop question answering requires models to retrieve, organize, and integrate multiple pieces of evidence before deriving the final answer\[mavi2024multi\]\. Unlike single\-hop question answering, where a single passage may contain sufficient information, multi\-hop questions usually involve scattered supporting facts distributed across different documents or contexts\[chen2019multi\]\. This setting poses several key challenges for retrieval\-augmented systems:
1. 1\.Retrieving implicit intermediate evidence\.Multi\-hop questions often require intermediate entities or relations that are not explicitly mentioned in the query\. Such evidence may have weak lexical or semantic similarity to the question, making it difficult for standard retrievers to identify all necessary supporting contexts\.
2. 2\.Distinguishing supporting evidence from distractors\.Retrieved contexts may contain passages that are topically related to the query but irrelevant to the final reasoning path\. In some cases, they may even introduce competing or misleading evidence, requiring the system to assess evidence reliability rather than relying only on retrieval relevance\.
3. 3\.Organizing evidence into coherent reasoning chains\.Even when relevant evidence is retrieved, it must be connected through entities and relations to form an interpretable reasoning path\. Simply concatenating loosely related context chunks provides limited support for faithful multi\-hop reasoning and makes it difficult to explain how the final answer is derived\.
Existing studies have explored several strategies for multi\-hop evidence retrieval and reasoning\. Multi\-hop dense retrieval methods retrieve supporting documents in multiple steps by using previously retrieved evidence to guide subsequent retrieval\[xiong2020answering\]\. Reasoning\-path retrieval methods further aim to identify explicit evidence paths over textual or graph\-structured corpora, making the retrieval process more interpretable\[asai2019learning\]\. More recently, iterative retrieval\-and\-reasoning approaches interleave evidence acquisition with intermediate reasoning, allowing LLMs to dynamically seek additional information for knowledge\-intensive multi\-step questions\[trivedi2023interleaving,yao2022react\]\. These studies collectively show that complex question answering benefits from a tighter interaction between retrieval and reasoning\.
Despite this progress, most existing methods still organize evidence as sequential passages, pairwise links, or linear reasoning paths\. Such representations are often insufficient when an answer depends on multiple evidence units that jointly support an inference\. Moreover, once evidence is retrieved, the post\-retrieval stage typically offers limited support for estimating evidence reliability, suppressing distracting contexts, and explaining how different evidence units are connected to support the final answer\.
In contrast, HyCE\-RAG focuses on confidence\-aware post\-retrieval reasoning over structured evidence\. It leverages the high\-order modeling capability of hypergraphs to organize retrieved entities, relations, and evidence units into hypergraph\-based evidence chains, and propagates confidence over this structure to identify more reliable answer\-supporting evidence\. This design enables HyCE\-RAG to better capture joint evidence dependencies, down\-weight off\-path or conflicting contexts, and provide more interpretable reasoning support for multi\-hop question answering\.
Related ideas also appear in long\-horizon decision\-making and vision–language–action reasoning, where models must maintain structured intermediate states and connect perception, language, and action evidence over extended reasoning steps\[jian2026pi\]\. Although the task setting is different from retrieval\-augmented question answering, both lines of work emphasize the importance of structured intermediate representations for reliable multi\-step reasoning\.
## 3Methodology
### 3\.1Overview
HyCE\-RAG consists of two main stages: offline hypergraph system construction and online retrieval\-augmented generation\. Inspired by the hypergraph construction paradigm of HyperGraphRAG\[luo2026hypergraphrag\], HyCE\-RAG constructs a persistent hypergraph in the offline stage\. The document corpus𝒟\\mathcal\{D\}is first divided into text chunks\. For each chunk, an LLM\-based extraction module identifies entities, hyperedges, and the incidence relations between them\. The extracted entities and hyperedges are then deduplicated, merged, and organized into a corpus\-level hypergraph𝒦\\mathcal\{K\}, in which vertices denote entities or evidence units and hyperedges represent higher\-order semantic associations\. Meanwhile, an entity\-level vector index is built from the names and descriptions of extracted entities, which supports semantic entry retrieval in the online stage\.
In the online stage, HyCE\-RAG performs question answering over the pre\-built hypergraph system\. Given a questionqq, it first identifies query\-relevant entry entities by combining LLM\-based query entity extraction and vector\-based entity retrieval\. Starting from these entry entities, HyCE\-RAG retrieves related hyperedges and assembles a query\-aware evidence hypergraph\. It then propagates confidence scores over the hypergraph, constructs multiple candidate evidence chains, distinguishes supporting and potentially contradictory chains, and finally generates an answer using the structured evidence context\.
The overall workflow can be summarized as:
𝒦\\displaystyle\\mathcal\{K\}=Build\(𝒟\),\\displaystyle=\\mathrm\{Build\}\(\\mathcal\{D\}\),\(1\)𝒱0\\displaystyle\\mathcal\{V\}\_\{0\}=Entry\(q,𝒦\),\\displaystyle=\\mathrm\{Entry\}\(q,\\mathcal\{K\}\),ℋq\\displaystyle\\mathcal\{H\}\_\{q\}=Retrieve\(𝒱0,𝒦\),\\displaystyle=\\mathrm\{Retrieve\}\(\\mathcal\{V\}\_\{0\},\\mathcal\{K\}\),𝐜∗\\displaystyle\\mathbf\{c\}^\{\*\}=Propagate\(ℋq,q\),\\displaystyle=\\mathrm\{Propagate\}\(\\mathcal\{H\}\_\{q\},q\),\(𝒞q\+,𝒞q−,δq\)\\displaystyle\(\\mathcal\{C\}\_\{q\}^\{\+\},\\mathcal\{C\}\_\{q\}^\{\-\},\\delta\_\{q\}\)=Reason\(ℋq,𝐜∗,q\),\\displaystyle=\\mathrm\{Reason\}\(\\mathcal\{H\}\_\{q\},\\mathbf\{c\}^\{\*\},q\),y∗\\displaystyle y^\{\*\}=Generate\(q,𝒞q\+,𝒞q−,δq\)\.\\displaystyle=\\mathrm\{Generate\}\(q,\\mathcal\{C\}\_\{q\}^\{\+\},\\mathcal\{C\}\_\{q\}^\{\-\},\\delta\_\{q\}\)\.
Here,𝒦\\mathcal\{K\}denotes the offline constructed hypergraph evidence store,𝒱0\\mathcal\{V\}\_\{0\}is the set of entry entities,ℋq\\mathcal\{H\}\_\{q\}is the query\-aware evidence hypergraph, and𝐜∗\\mathbf\{c\}^\{\*\}denotes the propagated confidence scores\.𝒞q\+\\mathcal\{C\}\_\{q\}^\{\+\}and𝒞q−\\mathcal\{C\}\_\{q\}^\{\-\}denote supporting and contradictory evidence chain sets, respectively,δq\\delta\_\{q\}is the estimated contradiction score, andy∗y^\{\*\}is the generated answer\.
Figure 3:Overview of the proposed HyCE\-RAG framework\. HyCE\-RAG first builds an offline hypergraph store from corpus level evidence, and then retrieves a query aware hypergraph for a given question\. Confidence propagation estimates the importance of entities and hyperedges through their incidence links\. Evidence units with high confidence and potential divergence are organized into a structured context for large language model answer generation\.
### 3\.2Offline Hypergraph Store Construction
In this stage, HyCE\-RAG converts the raw document corpus into a persistent hypergraph\-based knowledge store, which is later used by the online retrieval and reasoning stage\.
Given a document corpus𝒟=\{di\}i=1N\\mathcal\{D\}=\\\{d\_\{i\}\\\}\_\{i=1\}^\{N\}, each documentdid\_\{i\}is segmented into a sequence of overlapping text chunks:
𝒳i=Chunk\(di;L,O\)=\{xi,1,xi,2,…,xi,mi\},\\mathcal\{X\}\_\{i\}=\\operatorname\{Chunk\}\(d\_\{i\};L,O\)=\\\{x\_\{i,1\},x\_\{i,2\},\\ldots,x\_\{i,m\_\{i\}\}\\\},\(2\)whereLLis the maximum chunk length,OOis the overlap size, andmim\_\{i\}is the number of chunks generated from documentdid\_\{i\}\. The corpus\-level chunk collection is defined as:
𝒳=\{xi,k∣1≤i≤N,1≤k≤mi\}\.\\mathcal\{X\}=\\\{x\_\{i,k\}\\mid 1\\leq i\\leq N,\\ 1\\leq k\\leq m\_\{i\}\\\}\.\(3\)Each chunk keeps its source document identifier and chunk order, enabling the extracted knowledge to be traced back to the original corpus\.
For each chunkxi,kx\_\{i,k\}, HyCE\-RAG applies an LLM\-based information extraction module to extract entities, hyperedges, and their incidence relations:
\(𝒱^i,k,ℰ^i,k,𝒜^i,k\)=Extract\(xi,k\),\(\\widehat\{\\mathcal\{V\}\}\_\{i,k\},\\widehat\{\\mathcal\{E\}\}\_\{i,k\},\\widehat\{\\mathcal\{A\}\}\_\{i,k\}\)=\\operatorname\{Extract\}\(x\_\{i,k\}\),\(4\)where𝒱^i,k\\widehat\{\\mathcal\{V\}\}\_\{i,k\}denotes the extracted entity records,ℰ^i,k\\widehat\{\\mathcal\{E\}\}\_\{i,k\}denotes the extracted hyper\-relation records, and𝒜^i,k\\widehat\{\\mathcal\{A\}\}\_\{i,k\}denotes the incidence relations between them\. Each extracted hyper\-relation is instantiated as a hyperedge connecting the involved entities, while the source chunk is retained as provenance information for later retrieval\. Unlike a conventional graph edge that connects only two vertices, a hyperedge in HyCE\-RAG can connect multiple entities within the same evidence unit, thereby representing higher\-order associations among entities\.
After local extraction, HyCE\-RAG canonicalizes duplicated entities and equivalent hyperedges across chunks, and remaps the corresponding incidence links to global identifiers\. The corpus\-level hypergraph𝒢\\mathcal\{G\}is obtained:
𝒢=\(𝒱,ℰ,𝒜\),\\mathcal\{G\}=\(\\mathcal\{V\},\\mathcal\{E\},\\mathcal\{A\}\),\(5\)where𝒱\\mathcal\{V\}is the global entity set,ℰ\\mathcal\{E\}is the global hyperedge set, and𝒜⊆ℰ×𝒱\\mathcal\{A\}\\subseteq\\mathcal\{E\}\\times\\mathcal\{V\}is the global incidence relation\. Each hyperedgee∈ℰe\\in\\mathcal\{E\}corresponds to an extracted hyper\-relation unit and retains its source chunk information as provenance, enabling the associated textual context to be traced back to the original corpus when needed\. The detailed record formats, canonicalization mappings, and merge operations are provided in Appendix[A](https://arxiv.org/html/2607.22597#A1)\.
To support semantic entry retrieval, HyCE\-RAG further builds a vector\-based entity index:
ℐ𝒱=\{\(v,𝐳v\)∣v∈𝒱,𝐳v=fenc\(r\(v\)\)\},\\mathcal\{I\}\_\{\\mathcal\{V\}\}=\\\{\(v,\\mathbf\{z\}\_\{v\}\)\\mid v\\in\\mathcal\{V\},\\ \\mathbf\{z\}\_\{v\}=f\_\{\\mathrm\{enc\}\}\(r\(v\)\)\\\},\(6\)wherer\(v\)r\(v\)is the textual representation of entityvv, andfenc\(⋅\)f\_\{\\mathrm\{enc\}\}\(\\cdot\)denotes the embedding encoder\.
Finally, the offline stage produces a persistent hypergraph knowledge store:
𝒦=\(𝒢,ℐ𝒱\),\\mathcal\{K\}=\(\\mathcal\{G\},\\mathcal\{I\}\_\{\\mathcal\{V\}\}\),\(7\)where𝒢\\mathcal\{G\}supports hypergraph traversal and relation expansion, whileℐ𝒱\\mathcal\{I\}\_\{\\mathcal\{V\}\}supports vector\-based entity retrieval\.
### 3\.3Online Retrieval Augmented Generation
#### 3\.3\.1Initial Entry Retrieval
Given a questionqq, HyCE\-RAG first identifies a set of entry entities that serve as anchors for subsequent hypergraph expansion\. These entities are obtained from two complementary sources: explicit entity mentions extracted from the question and semantically relevant entities retrieved from the offline entity index\.
Explicit entity mentions are extracted from the question using an LLM:
ℳq=LLMExtract\(q\),\\mathcal\{M\}\_\{q\}=\\operatorname\{LLMExtract\}\(q\),\(8\)whereℳq\\mathcal\{M\}\_\{q\}denotes the set of entity mentions identified inqq\. The extracted mentions are then linked to the global entity set𝒱\\mathcal\{V\}through a deterministic linking procedure:
𝒱llm=Link\(ℳq,𝒱\)\.\\mathcal\{V\}\_\{\\mathrm\{llm\}\}=\\operatorname\{Link\}\(\\mathcal\{M\}\_\{q\},\\mathcal\{V\}\)\.\(9\)Here, the functionLink\\operatorname\{Link\}first applies exact string matching against canonical entity names, and then uses alias and synonym lookup when direct matches are unavailable\. This branch provides high\-precision entry entities that are explicitly grounded in the question\.
In parallel, HyCE\-RAG performs semantic entity retrieval over the vector\-based entity indexℐ𝒱\\mathcal\{I\}\_\{\\mathcal\{V\}\}constructed in the offline stage\. For each indexed entityv∈𝒱v\\in\\mathcal\{V\}, let𝐳v\\mathbf\{z\}\_\{v\}denote its precomputed embedding\. The question embedding is computed as:
𝐳q=fenc\(q\),\\mathbf\{z\}\_\{q\}=f\_\{\\mathrm\{enc\}\}\(q\),\(10\)and the semantic relevance betweenqqandvvis measured by:
svec\(q,v\)=sim\(𝐳q,𝐳v\),s\_\{\\mathrm\{vec\}\}\(q,v\)=\\operatorname\{sim\}\(\\mathbf\{z\}\_\{q\},\\mathbf\{z\}\_\{v\}\),\(11\)wheresim\(⋅,⋅\)\\operatorname\{sim\}\(\\cdot,\\cdot\)denotes the vector similarity function\. The top\-KvK\_\{v\}semantically relevant entities are selected as:
𝒱vec=TopKv∈𝒱Kvsvec\(q,v\)\.\\mathcal\{V\}\_\{\\mathrm\{vec\}\}=\\operatorname\{TopK\}\_\{v\\in\\mathcal\{V\}\}^\{K\_\{v\}\}s\_\{\\mathrm\{vec\}\}\(q,v\)\.\(12\)This branch improves recall by retrieving entities that may be relevant to the question even if they are not explicitly mentioned\.
The two candidate sets are then merged and deduplicated to obtain the initial entry entity set:
𝒱0=Dedup\(𝒱llm∪𝒱vec\)\.\\mathcal\{V\}\_\{0\}=\\operatorname\{Dedup\}\\left\(\\mathcal\{V\}\_\{\\mathrm\{llm\}\}\\cup\\mathcal\{V\}\_\{\\mathrm\{vec\}\}\\right\)\.\(13\)The resulting set𝒱0\\mathcal\{V\}\_\{0\}is used as the starting point for query\-aware hypergraph expansion\.
#### 3\.3\.2Hyperedge Retrieval and Query\-aware Hypergraph Assembly
After obtaining the entry entity set𝒱0\\mathcal\{V\}\_\{0\}, HyCE\-RAG retrieves relevant hyperedges by expanding from these query\-grounded entities over the corpus\-level hypergraph\. Letℰ\\mathcal\{E\}denote the corpus\-level hyperedge set\. Each hyperedgee∈ℰe\\in\\mathcal\{E\}is associated with a set of incident entities:
𝒱\(e\)=\{v1,v2,…,vm\}⊆𝒱,m≥2,\\mathcal\{V\}\(e\)=\\\{v\_\{1\},v\_\{2\},\\ldots,v\_\{m\}\\\}\\subseteq\\mathcal\{V\},\\quad m\\geq 2,\(14\)wheremmdenotes the number of entities connected byee\. The source textual segment ofeeis retained as its provenance text, denoted asτ\(e\)\\tau\(e\)\.
Instead of ranking all corpus\-level hyperedges globally, HyCE\-RAG first constructs a candidate hyperedge set by traversing the incidence structure from the entry entities:
ℰc=\{e∈ℰ∣𝒱\(e\)∩𝒱0≠∅\},\\mathcal\{E\}\_\{c\}=\\\{e\\in\\mathcal\{E\}\\mid\\mathcal\{V\}\(e\)\\cap\\mathcal\{V\}\_\{0\}\\neq\\emptyset\\\},\(15\)whereℰc\\mathcal\{E\}\_\{c\}contains hyperedges that are directly connected to at least one entry entity\. In implementation, this expansion can be extended to multi\-hop neighborhoods over the entity–hyperedge incidence graph to collect additional candidate hyperedges around the initial query entities\.
For each candidate hyperedgee∈ℰce\\in\\mathcal\{E\}\_\{c\}, HyCE\-RAG estimates its query relevance from both structural and textual perspectives:
shyp\(q,e\)=βsentry\(e,𝒱0\)\+\(1−β\)srel\(q,e\),s\_\{\\mathrm\{hyp\}\}\(q,e\)=\\beta s\_\{\\mathrm\{entry\}\}\(e,\\mathcal\{V\}\_\{0\}\)\+\(1\-\\beta\)s\_\{\\mathrm\{rel\}\}\(q,e\),\(16\)whereβ∈\[0,1\]\\beta\\in\[0,1\]controls the trade\-off between structural entry matching and textual relevance\.
The structural termsentry\(e,𝒱0\)s\_\{\\mathrm\{entry\}\}\(e,\\mathcal\{V\}\_\{0\}\)measures how strongly the hyperedge is connected to the entry entities extracted from the question\. It is defined as the fraction of incident entities ineethat overlap with𝒱0\\mathcal\{V\}\_\{0\}:
sentry\(e,𝒱0\)=\|𝒱\(e\)∩𝒱0\|\|𝒱\(e\)\|\+ϵ,s\_\{\\mathrm\{entry\}\}\(e,\\mathcal\{V\}\_\{0\}\)=\\frac\{\|\\mathcal\{V\}\(e\)\\cap\\mathcal\{V\}\_\{0\}\|\}\{\|\\mathcal\{V\}\(e\)\|\+\\epsilon\},\(17\)whereϵ\\epsilonis a small constant for numerical stability\.
The textual relevance termsrel\(q,e\)s\_\{\\mathrm\{rel\}\}\(q,e\)measures the relevance between the questionqqand the provenance textτ\(e\)\\tau\(e\)associated with hyperedgeee:
srel\(q,e\)=Rel\(q,τ\(e\)\),s\_\{\\mathrm\{rel\}\}\(q,e\)=\\operatorname\{Rel\}\(q,\\tau\(e\)\),\(18\)whereRel\(⋅\)\\operatorname\{Rel\}\(\\cdot\)denotes the normalized retrieval relevance score computed between the question and the source textual segment of the hyperedge\.
The query\-relevant hyperedges are then selected from the candidate set:
ℰq=TopKe∈ℰcKhshyp\(q,e\),\\mathcal\{E\}\_\{q\}=\\operatorname\{TopK\}\_\{e\\in\\mathcal\{E\}\_\{c\}\}^\{K\_\{h\}\}s\_\{\\mathrm\{hyp\}\}\(q,e\),\(19\)whereKhK\_\{h\}is the number of retained hyperedges\.
The query\-aware vertex set is obtained by collecting all entities covered by the selected hyperedges:
𝒱q=⋃e∈ℰq𝒱\(e\)\.\\mathcal\{V\}\_\{q\}=\\bigcup\_\{e\\in\\mathcal\{E\}\_\{q\}\}\\mathcal\{V\}\(e\)\.\(20\)
Finally, HyCE\-RAG assembles the query\-aware hypergraph as:
ℋq=\(𝒱q,ℰq,𝒜q\),\\mathcal\{H\}\_\{q\}=\(\\mathcal\{V\}\_\{q\},\\mathcal\{E\}\_\{q\},\\mathcal\{A\}\_\{q\}\),\(21\)where𝒜q=𝒜∩\(ℰq×𝒱q\)\\mathcal\{A\}\_\{q\}=\\mathcal\{A\}\\cap\(\\mathcal\{E\}\_\{q\}\\times\\mathcal\{V\}\_\{q\}\)denotes the incidence relations between the selected hyperedges and their participating entities\. Inℋq\\mathcal\{H\}\_\{q\}, vertices represent entities, while hyperedges represent query\-relevant structured units that connect multiple entities within the same textual segment\. Compared with ordinary pairwise edges, hyperedges preserve higher\-order associations among multiple entities, providing a structured basis for subsequent confidence propagation and evidence assembly\.
#### 3\.3\.3Confidence Propagation over the Hypergraph
Given the query\-aware hypergraphℋq=\(𝒱q,ℰq,𝒜q\)\\mathcal\{H\}\_\{q\}=\(\\mathcal\{V\}\_\{q\},\\mathcal\{E\}\_\{q\},\\mathcal\{A\}\_\{q\}\), HyCE\-RAG estimates the question\-conditioned importance of entities and hyperedges through hypergraph\-based confidence propagation, where𝒜q\\mathcal\{A\}\_\{q\}denotes the incidence relations between vertices and hyperedges\. The intuition is that an entity should receive high confidence if it is either directly relevant to the question or structurally connected to other high\-confidence entities through shared hyperedges\.
Each vertexvi∈𝒱qv\_\{i\}\\in\\mathcal\{V\}\_\{q\}is first assigned an initial query relevance score:
r^i=αs~vec\(q,vi\)\+\(1−α\)𝟏\(vi∈𝒱0\),\\widehat\{r\}\_\{i\}=\\alpha\\widetilde\{s\}\_\{\\mathrm\{vec\}\}\(q,v\_\{i\}\)\+\(1\-\\alpha\)\\mathbf\{1\}\(v\_\{i\}\\in\\mathcal\{V\}\_\{0\}\),\(22\)wheres~vec\(q,vi\)∈\[0,1\]\\widetilde\{s\}\_\{\\mathrm\{vec\}\}\(q,v\_\{i\}\)\\in\[0,1\]is the normalized semantic similarity between the questionqqand entityviv\_\{i\}, and𝟏\(vi∈𝒱0\)\\mathbf\{1\}\(v\_\{i\}\\in\\mathcal\{V\}\_\{0\}\)indicates whetherviv\_\{i\}belongs to the initial entry entity set\. The coefficientα∈\[0,1\]\\alpha\\in\[0,1\]controls the trade\-off between semantic relevance and explicit entry matching\.
The initial scores are normalized into a restart distribution:
𝐫=𝐫^‖𝐫^‖1\+ϵ,𝐫^=\[r^1,…,r^\|𝒱q\|\]⊤,\\mathbf\{r\}=\\frac\{\\widehat\{\\mathbf\{r\}\}\}\{\\\|\\widehat\{\\mathbf\{r\}\}\\\|\_\{1\}\+\\epsilon\},\\qquad\\widehat\{\\mathbf\{r\}\}=\[\\widehat\{r\}\_\{1\},\\ldots,\\widehat\{r\}\_\{\|\\mathcal\{V\}\_\{q\}\|\}\]^\{\\top\},\(23\)whereϵ\\epsilonis a small constant for numerical stability\. The initial confidence vector is set as𝐜\(0\)=𝐫\\mathbf\{c\}^\{\(0\)\}=\\mathbf\{r\}\.
The incidence structure ofℋq\\mathcal\{H\}\_\{q\}is encoded by𝐁∈\{0,1\}\|𝒱q\|×\|ℰq\|\\mathbf\{B\}\\in\\\{0,1\\\}^\{\|\\mathcal\{V\}\_\{q\}\|\\times\|\\mathcal\{E\}\_\{q\}\|\}:
𝐁iℓ=\{1,if\(vi,eℓ\)∈𝒜q,0,otherwise\.\\mathbf\{B\}\_\{i\\ell\}=\\begin\{cases\}1,&\\text\{if \}\(v\_\{i\},e\_\{\\ell\}\)\\in\\mathcal\{A\}\_\{q\},\\\\ 0,&\\text\{otherwise\}\.\\end\{cases\}\(24\)The vertex\-degree and hyperedge\-degree diagonal matrices are defined as:
𝐃v\(i,i\)=∑ℓ𝐁iℓ,𝐃e\(ℓ,ℓ\)=∑i𝐁iℓ\.\\mathbf\{D\}\_\{v\}\(i,i\)=\\sum\_\{\\ell\}\\mathbf\{B\}\_\{i\\ell\},\\qquad\\mathbf\{D\}\_\{e\}\(\\ell,\\ell\)=\\sum\_\{i\}\\mathbf\{B\}\_\{i\\ell\}\.\(25\)Isolated vertices and empty hyperedges are removed fromℋq\\mathcal\{H\}\_\{q\}, ensuring that all retained degrees are strictly positive\.
Confidence propagation is modeled as a two\-stage random walk over the hypergraph\. Starting from a vertex, confidence is first distributed uniformly to its incident hyperedges, and then redistributed uniformly from each hyperedge to its incident vertices\. For column\-vector confidence scores, the transition matrix is:
𝐒=𝐁𝐃e−1𝐁⊤𝐃v−1\.\\mathbf\{S\}=\\mathbf\{B\}\\mathbf\{D\}\_\{e\}^\{\-1\}\\mathbf\{B\}^\{\\top\}\\mathbf\{D\}\_\{v\}^\{\-1\}\.\(26\)
At propagation stept=0,1,…,K−1t=0,1,\\ldots,K\-1, the vertex confidence vector is updated with a query\-aware restart mechanism:
𝐜\(t\+1\)=λ𝐫\+\(1−λ\)𝐒𝐜\(t\),\\mathbf\{c\}^\{\(t\+1\)\}=\\lambda\\mathbf\{r\}\+\(1\-\\lambda\)\\mathbf\{S\}\\mathbf\{c\}^\{\(t\)\},\(27\)whereλ∈\(0,1\]\\lambda\\in\(0,1\]controls the restart strength\. The restart term preserves the original query relevance signal, while the diffusion term propagates confidence through higher\-order hypergraph connectivity\.
Since𝐒\\mathbf\{S\}is column\-stochastic andλ\>0\\lambda\>0, the propagation process converges to a unique fixed point:
𝐜∞=λ\(𝐈−\(1−λ\)𝐒\)−1𝐫\.\\mathbf\{c\}^\{\\infty\}=\\lambda\\left\(\\mathbf\{I\}\-\(1\-\\lambda\)\\mathbf\{S\}\\right\)^\{\-1\}\\mathbf\{r\}\.\(28\)The proof is provided in Appendix[B](https://arxiv.org/html/2607.22597#A2)\. In practice, HyCE\-RAG performs a finite number of propagation steps and uses𝐜∗=𝐜\(K\)\\mathbf\{c\}^\{\*\}=\\mathbf\{c\}^\{\(K\)\}as an efficient approximation to𝐜∞\\mathbf\{c\}^\{\\infty\}\.
Finally, the confidence score of each hyperedge is computed by aggregating the final confidence scores of its incident vertices:
ρ\(eℓ\)=1𝐃e\(ℓ,ℓ\)∑i=1\|𝒱q\|𝐁iℓ𝐜i∗\.\\rho\(e\_\{\\ell\}\)=\\frac\{1\}\{\\mathbf\{D\}\_\{e\}\(\\ell,\\ell\)\}\\sum\_\{i=1\}^\{\|\\mathcal\{V\}\_\{q\}\|\}\\mathbf\{B\}\_\{i\\ell\}\\mathbf\{c\}^\{\*\}\_\{i\}\.\(29\)The resulting vertex scores quantify question\-aware entity importance, while the hyperedge scores estimate the relevance and reliability of selected hyperedges for subsequent evidence\-chain construction\.
#### 3\.3\.4Confidence\-guided Evidence Assembly and Multi\-path Fusion
After confidence propagation, the high\-confidence region of the query\-aware hypergraph is converted into compact evidence\-level reasoning paths\. Each selected hyperedge corresponds to an extracted evidence unit, and its incident entities indicate the concepts involved in that evidence\. Rather than exhaustively enumerating all symbolic paths, the method constructs hyperedge\-centered paths that preserve the most informative higher\-order evidence associations\.
For each hyperedgee∈ℰqe\\in\\mathcal\{E\}\_\{q\}, HyCE\-RAG keeps two auxiliary extraction signals from the offline construction stage\. The first is an extraction confidence scoreγ\(e\)∈\[0,1\]\\gamma\(e\)\\in\[0,1\], which reflects the reliability of the extracted evidence unit\. The second is a set of extracted directed relationsℛ\(e\)\\mathcal\{R\}\(e\), where each relationr∈ℛ\(e\)r\\in\\mathcal\{R\}\(e\)is associated with a confidence scoreconf\(r\)∈\[0,1\]\\mathrm\{conf\}\(r\)\\in\[0,1\]\. These signals are used only for evidence scoring and context organization, while the hypergraph structure is still defined by entities, hyperedges, and their incidence relations\.
Letℱq⊆𝒱q\\mathcal\{F\}\_\{q\}\\subseteq\\mathcal\{V\}\_\{q\}denote the retained high\-confidence entities:
ℱq=\{vi∈𝒱q∣𝐜i∗≥θv\},\\mathcal\{F\}\_\{q\}=\\\{v\_\{i\}\\in\\mathcal\{V\}\_\{q\}\\mid\\mathbf\{c\}^\{\*\}\_\{i\}\\geq\\theta\_\{v\}\\\},\(30\)whereθv∈\[0,1\]\\theta\_\{v\}\\in\[0,1\]is a confidence threshold\. For each hyperedgee∈ℰqe\\in\\mathcal\{E\}\_\{q\}, the retained entities covered byeeare:
ℱ\(e\)=\{v∈ℱq∣\(v,e\)∈𝒜q\}\.\\mathcal\{F\}\(e\)=\\\{v\\in\\mathcal\{F\}\_\{q\}\\mid\(v,e\)\\in\\mathcal\{A\}\_\{q\}\\\}\.\(31\)A hyperedge is considered a candidate evidence unit ifℱ\(e\)≠∅\\mathcal\{F\}\(e\)\\neq\\emptyset\.
Each candidate evidence unit is assigned a confidence\-guided score:
S\(e\)=\\displaystyle S\(e\)=\{\}wcovCov\(e\)\+wpropρ\(e\)\+wextγ\(e\)\\displaystyle w\_\{\\mathrm\{cov\}\}\\mathrm\{Cov\}\(e\)\+w\_\{\\mathrm\{prop\}\}\\rho\(e\)\+w\_\{\\mathrm\{ext\}\}\\gamma\(e\)\(32\)\+wentryIentry\(e\)\+wrelηrel\(e\)\.\\displaystyle\+w\_\{\\mathrm\{entry\}\}I\_\{\\mathrm\{entry\}\}\(e\)\+w\_\{\\mathrm\{rel\}\}\\eta\_\{\\mathrm\{rel\}\}\(e\)\.Here,Cov\(e\)\\mathrm\{Cov\}\(e\)is the normalized coverage of retained entities,ρ\(e\)\\rho\(e\)is the propagated hyperedge confidence from Eq\. \([29](https://arxiv.org/html/2607.22597#S3.E29)\), andγ\(e\)\\gamma\(e\)is the extraction confidence score\. The indicatorIentry\(e\)I\_\{\\mathrm\{entry\}\}\(e\)rewards evidence units that contain initial entry entities, whileηrel\(e\)\\eta\_\{\\mathrm\{rel\}\}\(e\)measures the reliability of extracted directed relations associated withee\. All components are normalized to\[0,1\]\[0,1\], and the weights are tunable hyperparameters controlling their relative contributions\.
The extraction\-confidence termwextγ\(e\)w\_\{\\mathrm\{ext\}\}\\gamma\(e\)serves as a noise\-aware safeguard rather than a purely auxiliary score\. Since the hypergraph is constructed from automatically extracted entities, relations, and evidence units, extraction errors may otherwise be amplified during confidence propagation and evidence assembly\. By explicitly incorporatingγ\(e\)\\gamma\(e\)into the evidence score, HyCE\-RAG down\-weights evidence units whose textual extraction is uncertain, even if they cover several retained entities or receive high propagated confidence from neighboring structures\. This design reduces the risk that noisy or spurious evidence becomes a dominant reasoning path\. Meanwhile, the propagation and coverage terms still allow moderately confident evidence to be retained when it is structurally important, which balances robustness against extraction noise with the need to recover indirect multi\-hop evidence\.
The coverage term is defined as:
Cov\(e\)=\|ℱ\(e\)\|maxe′∈ℰq\|ℱ\(e′\)\|\+ϵ,\\mathrm\{Cov\}\(e\)=\\frac\{\|\\mathcal\{F\}\(e\)\|\}\{\\max\_\{e^\{\\prime\}\\in\\mathcal\{E\}\_\{q\}\}\|\\mathcal\{F\}\(e^\{\\prime\}\)\|\+\\epsilon\},\(33\)whereϵ\\epsilonavoids division by zero\. If no retained entity is covered by any hyperedge, the candidate evidence set is empty and the system falls back to the initially retrieved hyperedges ranked by their retrieval scores\.
The entry indicator is:
Ientry\(e\)=𝟏\(𝒱\(e\)∩𝒱0≠∅\),I\_\{\\mathrm\{entry\}\}\(e\)=\\mathbf\{1\}\\left\(\\mathcal\{V\}\(e\)\\cap\\mathcal\{V\}\_\{0\}\\neq\\emptyset\\right\),\(34\)where𝒱\(e\)=\{v∈𝒱q∣\(v,e\)∈𝒜q\}\\mathcal\{V\}\(e\)=\\\{v\\in\\mathcal\{V\}\_\{q\}\\mid\(v,e\)\\in\\mathcal\{A\}\_\{q\}\\\}denotes the set of entities incident to hyperedgeee\.
The relation\-level signal is computed from the directed relations associated withee:
ηrel\(e\)=\{0,\|ℛ\(e\)\|=0,1\|ℛ\(e\)\|∑r∈ℛ\(e\)conf\(r\),\|ℛ\(e\)\|\>0,\\eta\_\{\\mathrm\{rel\}\}\(e\)=\\begin\{cases\}0,&\|\\mathcal\{R\}\(e\)\|=0,\\\\\[4\.0pt\] \\displaystyle\\frac\{1\}\{\|\\mathcal\{R\}\(e\)\|\}\\sum\_\{r\\in\\mathcal\{R\}\(e\)\}\\mathrm\{conf\}\(r\),&\|\\mathcal\{R\}\(e\)\|\>0,\\end\{cases\}\(35\)whereconf\(r\)\\mathrm\{conf\}\(r\)is the extraction confidence score of directed relationrr\.
The top\-ranked evidence units are selected as:
ℰq∗=TopL\(\{e∈ℰq∣ℱ\(e\)≠∅\},S\(e\)\),\\mathcal\{E\}\_\{q\}^\{\*\}=\\operatorname\{Top\}\_\{L\}\\left\(\\\{e\\in\\mathcal\{E\}\_\{q\}\\mid\\mathcal\{F\}\(e\)\\neq\\emptyset\\\},S\(e\)\\right\),\(36\)whereLLis the maximum number of evidence units retained for answer generation\.
For each selected hyperedgee∈ℰq∗e\\in\\mathcal\{E\}\_\{q\}^\{\*\}, an evidence\-level path is constructed as:
pe=\(ℱ\(e\),e,ℛ\(e\),S\(e\),γ\(e\)\)\.p\_\{e\}=\\left\(\\mathcal\{F\}\(e\),e,\\mathcal\{R\}\(e\),S\(e\),\\gamma\(e\)\\right\)\.\(37\)This representation records the retained entities, the corresponding hyperedge, extracted directed relations, the overall evidence score, and the extraction confidence\. AlthoughS\(e\)S\(e\)already incorporatesγ\(e\)\\gamma\(e\), the extraction confidence is kept explicitly so that the answer generator can distinguish structural relevance from extraction reliability\. For a pathpep\_\{e\}, its score is defined as:
S\(pe\)=S\(e\)\.S\(p\_\{e\}\)=S\(e\)\.\(38\)
Since different evidence units may describe similar facts or share overlapping entities, path\-level fusion is applied to reduce redundancy\. For two evidence pathspep\_\{e\}andpe′p\_\{e^\{\\prime\}\}, their entity overlap is measured by the Jaccard coefficient:
J\(pe,pe′\)=\|ℱ\(e\)∩ℱ\(e′\)\|\|ℱ\(e\)∪ℱ\(e′\)\|\.J\(p\_\{e\},p\_\{e^\{\\prime\}\}\)=\\frac\{\|\\mathcal\{F\}\(e\)\\cap\\mathcal\{F\}\(e^\{\\prime\}\)\|\}\{\|\\mathcal\{F\}\(e\)\\cup\\mathcal\{F\}\(e^\{\\prime\}\)\|\}\.\(39\)Paths withJ\(pe,pe′\)≥τJ\(p\_\{e\},p\_\{e^\{\\prime\}\}\)\\geq\\tauare regarded as highly overlapping, whereτ\\tauis an overlap threshold\.
HyCE\-RAG uses a greedy clustering procedure for path fusion\. All paths are first sorted in descending order ofS\(p\)S\(p\)\. The highest\-scoring unassigned path is used as a seed, and all remaining unassigned paths whose Jaccard overlap with the seed is at leastτ\\tauare assigned to the same group\. The grouped paths are then marked as assigned, and the procedure continues with the next highest\-scoring unassigned path\. Within each group, the highest\-scoring path is retained as the representative\. This procedure ensures that each path belongs to exactly one group\. The resulting compact set of representative evidence paths is denoted as𝒫q\\mathcal\{P\}\_\{q\}\.
The representative paths are further separated according to their relative confidence:
𝒫q\+=\{p∈𝒫q∣S\(p\)≥θsSmax\},𝒫q−=𝒫q∖𝒫q\+,\\mathcal\{P\}\_\{q\}^\{\+\}=\\\{p\\in\\mathcal\{P\}\_\{q\}\\mid S\(p\)\\geq\\theta\_\{s\}S\_\{\\max\}\\\},\\qquad\\mathcal\{P\}\_\{q\}^\{\-\}=\\mathcal\{P\}\_\{q\}\\setminus\\mathcal\{P\}\_\{q\}^\{\+\},\(40\)whereSmax=maxp∈𝒫qS\(p\)S\_\{\\max\}=\\max\_\{p\\in\\mathcal\{P\}\_\{q\}\}S\(p\)andθs∈\[0,1\]\\theta\_\{s\}\\in\[0,1\]is a relative confidence threshold\. The set𝒫q\+\\mathcal\{P\}\_\{q\}^\{\+\}contains the main supporting evidence paths, while𝒫q−\\mathcal\{P\}\_\{q\}^\{\-\}contains lower\-confidence or potentially divergent paths\.
HyCE\-RAG does not aggressively discard conflicting or low\-confidence evidence during retrieval\. Instead, it adopts a conservative evidence exposure strategy: high\-confidence supporting paths and lower\-confidence paths are preserved separately in the structured context\. This allows the LLM to rely primarily on the strongest evidence while remaining aware of weaker, uncertain, or potentially inconsistent evidence\.
#### 3\.3\.5Structured Context Construction and Answer Generation
After evidence scoring and path\-level fusion, the selected evidence is linearized into a structured context for answer generation\. Unlike direct passage concatenation, the constructed context preserves the organization of supporting paths, lower\-confidence paths, extracted directed relations, evidence scores, and extraction reliability signals\.
Using the path sets𝒫q\+\\mathcal\{P\}\_\{q\}^\{\+\}and𝒫q−\\mathcal\{P\}\_\{q\}^\{\-\}obtained above, the structured evidence context is constructed as:
𝒮q=Ctx\(q,𝒫q\+,𝒫q−\),\\mathcal\{S\}\_\{q\}=\\mathrm\{Ctx\}\\left\(q,\\mathcal\{P\}\_\{q\}^\{\+\},\\mathcal\{P\}\_\{q\}^\{\-\}\\right\),\(41\)where𝒮q\\mathcal\{S\}\_\{q\}is the final structured context provided to the answer generator\.
The context is organized into several fields\. First, the supporting paths in𝒫q\+\\mathcal\{P\}\_\{q\}^\{\+\}are ranked by their evidence scores and presented as the primary reasoning basis\. Each path includes its involved entities, textual evidence segment, extracted directed relations, overall evidence score, and extraction confidence\. Second, the lower\-confidence paths in𝒫q−\\mathcal\{P\}\_\{q\}^\{\-\}are included when available, exposing weaker, uncertain, or potentially inconsistent evidence to the LLM\. This separation encourages the generator to prioritize high\-confidence evidence while remaining aware of alternative or conflicting information\.
The final answer is generated by conditioning the LLM on both the question and the structured evidence context:
y∗=LLM\(q,𝒮q\)\.y^\{\*\}=\\mathrm\{LLM\}\\left\(q,\\mathcal\{S\}\_\{q\}\\right\)\.\(42\)
Through this structured generation process, HyCE\-RAG provides the LLM with an interpretable evidence organization rather than an unstructured collection of retrieved passages\. By integrating query\-aware retrieval, confidence propagation, relation\-aware evidence assembly, conservative conflict exposure, and structured context construction, HyCE\-RAG supports more reliable and explainable answer generation\.
## 4Experiments
We conduct experiments to evaluate HyCE\-RAG from four perspectives: answer generation performance, retrieval quality, evidence organization, and component effectiveness\. Specifically, we aim to answer the following research questions:
RQ1:Does HyCE\-RAG improve answer generation performance on multi hop question answering tasks?
RQ2:Does confidence propagation over the hypergraph improve the quality of retrieved evidence?
RQ3:How do confidence propagation and hyperedge\-based evidence assembly contribute to the final performance?
RQ4:Can HyCE\-RAG provide interpretable evidence structures for complex multi\-hop question answering?
### 4\.1Experimental Setup
#### 4\.1\.1Datasets
To evaluate HyCE\-RAG across both general and domain\-specific reasoning scenarios, we conduct experiments on three established multi\-hop question answering benchmarks, namely HotpotQA\[yang2018hotpotqa\], 2WikiMultihopQA\[ho2020constructing\], and MuSiQue\[trivedi2022musique\], as well as two domain\-specific subsets of the GraphRAG Benchmark\[xiao2025graphrag\]\. Below we summarize the key characteristics of each evaluation setting\.
HotpotQA\.HotpotQA is a multi hop question answering dataset that requires reasoning over multiple Wikipedia passages\. It contains approximately 90,000 question answer pairs under the distractor setting, in which each question is paired with both gold supporting passages and distractor passages\. This setup enables evaluation of whether HyCE\-RAG can identify useful evidence while suppressing irrelevant information\.
2WikiMultihopQA\.2WikiMultihopQA contains approximately 193,000 questions, each requiring reasoning over two to four Wikipedia articles\. The dataset emphasizes compositional reasoning, including comparison, inference, and bridge style reasoning across multiple entities\.
MuSiQue\.MuSiQue is a challenging benchmark with approximately 25,000 questions, each requiring two to four reasoning steps\. Unlike datasets whose questions can often be solved through shortcut reasoning, MuSiQue is designed to require explicit decomposition and coherent multi step evidence aggregation\.
GraphRAG Benchmark\.The GraphRAG Benchmark evaluates graph based retrieval augmented generation in structured long context settings\. We use both the medical and novel subsets\. The medical subset focuses on factual retrieval and complex reasoning over clinical resources, including treatment guidelines and diagnostic knowledge\. The novel subset requires reasoning over characters, events, temporal dependencies, and cross document narrative relations\. Together, these two subsets evaluate HyCE\-RAG under both knowledge intensive and narrative reasoning scenarios\.
#### 4\.1\.2Baselines
We compare HyCE\-RAG with representative baselines that cover closed\-book generation, standard retrieval\-augmented generation, and graph\-based retrieval\-augmented generation\.
No Context\.The LLM answers each question using only its parametric knowledge, without access to any retrieved or provided external evidence\. This setting follows the closed\-book QA paradigm\[roberts2020much\]and serves as a lower bound for measuring how much external evidence is needed for each dataset\.
Vector\-based RAG\.This baseline retrieves passages according to dense semantic similarity between the question and candidate passages, following the standard dense retrieval and retrieval\-augmented generation paradigm\[karpukhin2020dense,lewis2020retrieval\]\. The top\-ranked passages are concatenated and provided to the LLM for answer generation\. It represents the standard retrieve\-then\-generate pipeline without explicit graph or hypergraph structure\.
GraphRAG\.GraphRAG constructs a graph\-based representation over the corpus and retrieves evidence through graph\-structured search or neighborhood expansion\[edge2024local\]\. This baseline evaluates whether pairwise graph relations can improve evidence retrieval compared with purely vector\-based retrieval\.
LightRAG\.LightRAG combines efficient indexing with graph\-aware retrieval\[guo2024lightrag\]\. It uses both semantic retrieval signals and structured associations to retrieve relevant evidence for generation, providing a strong graph\-enhanced RAG comparison\.
For a fair comparison, all methods use the same answer generator, prompt template, and generation parameters unless otherwise specified\.
#### 4\.1\.3Evaluation Metrics
Following the evaluation protocols used in recent benchmarks such as GraphRAG Benchmark\[xiao2025graphrag\]and LinearRAG\[zhuang2025linearrag\], we evaluate each method comprehensively\. Traditional QA evaluation metrics, such as Exact Match \(EM\) or F1\-score, primarily focus on literal string matching or the extraction of specific entities\. However, in complex multi\-hop reasoning scenarios, datasets often lack fine\-grained ground\-truth annotations for intermediate reasoning paths, making these lexical metrics inadequate and prone to false negatives\. To more accurately assess the semantic correctness, logical coherence, and factual grounding of the models, we adopt the widely recognized LLM\-as\-a\-judge paradigm\. Specifically, we evaluate each method from three complementary aspects: whether the final answer is accurate, whether the retrieved context is relevant to the question, and whether the answer is supported by the retrieved context\. These aspects are measured by answer accuracy, context relevance, and faithfulness, respectively\.
Answer Accuracy\.Answer accuracy \(Acc\\mathrm\{Acc\}\) evaluates whether the generated answer is consistent with the reference answer in terms of both factual content and semantic meaning\. Given a generated answeraaand a reference answera^\\hat\{a\}, an LLM evaluator decomposes them into atomic factual statements and compares the resulting statement sets\. It identifies true positives \(TPTP\), false positives \(FPFP\), and false negatives \(FNFN\), whereTPTPdenotes correctly covered reference facts,FPFPdenotes incorrect facts introduced by the generated answer, andFNFNdenotes reference facts missed by the generated answer\. The factual matching score is computed as:
Ffact=TPTP\+12\(FP\+FN\)\.F\_\{\\mathrm\{fact\}\}=\\frac\{TP\}\{TP\+\\frac\{1\}\{2\}\(FP\+FN\)\}\.\(43\)To account for semantically equivalent expressions, we further compute an embedding\-based semantic similarity scoreSsem\(a,a^\)S\_\{\\mathrm\{sem\}\}\(a,\\hat\{a\}\)\. The final answer accuracy score is computed as:
Acc=αFfact\+\(1−α\)Ssem\(a,a^\),\\mathrm\{Acc\}=\\alpha F\_\{\\mathrm\{fact\}\}\+\(1\-\\alpha\)S\_\{\\mathrm\{sem\}\}\(a,\\hat\{a\}\),\(44\)whereα\\alphacontrols the relative contribution of factual matching and semantic similarity\.
Context Relevance\.Context relevance \(Rel\\mathrm\{Rel\}\) measures whether the retrieved context is useful for answering the input question\. Given a questionqqand the retrieved contextCC, we assess relevance from two complementary perspectives\. First, an LLM evaluator judges whetherCCcontains information needed to answerqqand assigns a relevance scoreRelLLM\(q,C\)\\mathrm\{Rel\}\_\{\\mathrm\{LLM\}\}\(q,C\)\. Second, we compute an embedding\-based semantic relevance scoreRelsim\(q,C\)\\mathrm\{Rel\}\_\{\\mathrm\{sim\}\}\(q,C\)between the question and the retrieved context\. The final context relevance score is computed as:
Rel=λRelLLM\(q,C\)\+\(1−λ\)Relsim\(q,C\),\\mathrm\{Rel\}=\\lambda\\mathrm\{Rel\}\_\{\\mathrm\{LLM\}\}\(q,C\)\+\(1\-\\lambda\)\\mathrm\{Rel\}\_\{\\mathrm\{sim\}\}\(q,C\),\(45\)whereλ\\lambdacontrols the relative contribution of LLM\-based relevance judgment and embedding\-based semantic relevance\.
Faithfulness\.Faithfulness \(Faith\\mathrm\{Faith\}\) measures whether the generated answer is grounded in the retrieved context\. Given a generated answeraaand the retrieved contextCC, an LLM evaluator first decomposesaainto atomic factual statements\. For each statement, the LLM evaluator determines whether it is supported byCC\. The faithfulness score is defined as the proportion of supported statements:
Faith=NsupportedNtotal,\\mathrm\{Faith\}=\\frac\{N\_\{\\mathrm\{supported\}\}\}\{N\_\{\\mathrm\{total\}\}\},\(46\)whereNtotalN\_\{\\mathrm\{total\}\}is the total number of atomic statements extracted from the generated answer, andNsupportedN\_\{\\mathrm\{supported\}\}is the number of statements supported by the retrieved context\. A higher faithfulness score indicates that the generated answer is better grounded in the retrieved evidence and contains fewer unsupported claims\.
#### 4\.1\.4Implementation Details
All experiments employgpt\-oss\-120bas the backbone language model for both hypergraph construction and answer generation, encompassing entity extraction, relation extraction, evidence hyperedge construction, and final response generation\[openai2025gptoss120bgptoss20bmodel\]\. The model is deployed usingvLLMto enable efficient inference\[kwon2023efficient\]\. All experiments are conducted on a server equipped with six NVIDIA RTX 4090 GPUs\.
We usesentence\-transformers/all\-MiniLM\-L6\-v2as the embedding model throughout all embedding\-based components\. Specifically, it is used to build dense indexes and encode entities, queries, passages, and document chunks for similarity search and initial evidence retrieval\. The same embedding model is also used by the vector\-based RAG baseline, ensuring that performance differences are not caused by different dense encoders\.
We use a fixed set of hyperparameters for HyCE\-RAG across all test examples\. The detailed hyperparameter settings, including the number of entry entities, expansion hops, propagation steps, and selected evidence units, are reported in Appendix[C](https://arxiv.org/html/2607.22597#A3)\. For fair comparison, all retrieval\-based methods are evaluated under comparable evidence budgets and input length constraints\.
### 4\.2Results and Discussion
Table[1](https://arxiv.org/html/2607.22597#S4.T1)and Table[2](https://arxiv.org/html/2607.22597#S4.T2)report the results on multi\-hop QA and GraphRAG\-Bench datasets, respectively\. Answer quality is evaluated by answer correctness, while context relevance and faithfulness measure the quality of retrieved evidence when external context is available\. For the No Context baseline, relevance and faithfulness are not applicable, as no external evidence is retrieved\.
Table 1:Main results on multi\-hop QA datasets\. All values are percentages\.Acc\\mathrm\{Acc\},Rel\\mathrm\{Rel\}, andFaith\\mathrm\{Faith\}denote answer correctness, context relevance, and faithfulness\. N/A denotes metrics not applicable to methods without retrieved context\.DatasetMethodAccRelFaithHotpotQANo Context31\.11N/AN/AVector RAG48\.3156\.2754\.84GraphRAG42\.2047\.0951\.13LightRAG60\.1758\.6254\.61HyCE\-RAG71\.5761\.5460\.102WikiNo Context32\.64N/AN/AVector RAG39\.5248\.2751\.11GraphRAG46\.6045\.6648\.19LightRAG52\.8257\.3454\.29HyCE\-RAG70\.9766\.7656\.09MuSiQueNo Context17\.82N/AN/AVector RAG19\.2634\.6237\.08GraphRAG14\.9428\.1544\.57LightRAG27\.1234\.6537\.22HyCE\-RAG56\.7357\.1679\.23
Table 2:Main results on GraphRAG\-Bench datasets\. All values are percentages\.Acc\\mathrm\{Acc\},Rel\\mathrm\{Rel\}, andFaith\\mathrm\{Faith\}denote answer correctness, context relevance, and faithfulness\. N/A denotes metrics not applicable to methods without retrieved context\.DatasetMethodAccRelFaithMedicalNo Context37\.31N/AN/AVector RAG49\.1253\.2858\.62GraphRAG53\.3657\.6469\.21LightRAG54\.2761\.2767\.09HyCE\-RAG70\.5864\.5381\.71NovelNo Context24\.29N/AN/AVector RAG44\.3755\.6758\.27GraphRAG48\.8352\.1956\.78LightRAG51\.1256\.0961\.24HyCE\-RAG66\.4962\.1879\.83
Overall, HyCE\-RAG consistently achieves the best performance across all datasets and all applicable metrics\. On the multi\-hop QA benchmarks, HyCE\-RAG improves answer correctness by 11\.4, 18\.2, and 29\.6 absolute points over the strongest baseline on HotpotQA, 2Wiki, and MuSiQue, respectively\. On GraphRAG\-Bench, it also outperforms all baselines, with accuracy gains of 16\.3 points on Medical and 15\.4 points on Novel\. These results demonstrate that HyCE\-RAG provides more effective evidence for complex question answering than both dense vector retrieval and existing graph\-based retrieval methods\.
Prior studies\[xiang2025use\]have shown that graph\-based RAG can be beneficial for multi\-hop question answering because graph search captures relations among documents and entities, rather than treating retrieved chunks as an independent ranked list\. However, our results indicate that graph construction alone is not sufficient\. GraphRAG does not consistently outperform the vector\-based baseline, especially on HotpotQA and MuSiQue, suggesting that simply summarizing or aggregating graph communities may introduce noisy or weakly relevant evidence\. This issue becomes more serious when the retrieved context contains both supporting and distracting information\.
The advantage of HyCE\-RAG is most evident on MuSiQue, where the task requires reasoning over multiple connected pieces of evidence while filtering out misleading contexts\. HyCE\-RAG improves context relevance from 34\.65% to 57\.16% and faithfulness from 44\.57% to 79\.23% over the strongest corresponding baselines, corresponding to relative gains of 65\.0% and 77\.8%, respectively\.
This large improvement suggests that directly extracting a subgraph is not the final goal; the system must further identify the reasoning thread within the retrieved structure\. HyCE\-RAG addresses this problem through confidence propagation over entities and hyperedges, followed by relation\-aware evidence scoring\. This design assigns higher scores to evidence units that are structurally connected, semantically relevant, and supported by reliable extracted relations\. A qualitative case study in Section[4\.4](https://arxiv.org/html/2607.22597#S4.SS4)further illustrates how such propagation helps HyCE\-RAG identify a coherent evidence path for multi\-hop reasoning\.
Compared with LightRAG, HyCE\-RAG further benefits from evidence\-level confidence estimation rather than relying only on graph\-guided retrieval\. The propagated confidence scores help prioritize coherent evidence paths before generation, allowing the language model to condition on more reliable and informative context\. As a result, HyCE\-RAG produces answers with both higher correctness and stronger grounding, as reflected by the consistent improvements in faithfulness across all datasets\.
In addition, we note that the construction of the hypergraph is performed in an offline stage\. Although this stage may involve LLM\-based information extraction, it is a one\-time preprocessing cost for a fixed corpus\. During online inference, HyCE\-RAG mainly performs retrieval, confidence propagation, and evidence scoring over a sparse hypergraph structure, which can be efficiently implemented with sparse matrix operations\. Therefore, the additional structural modeling cost does not substantially change the online generation pipeline\.
### 4\.3Ablation Study
To answer RQ3, we conduct an ablation study to examine the contribution of the core components in HyCE\-RAG\. Due to the computational cost of reconstructing hypergraph indexes and rerunning generation, we perform ablations on MuSiQue, a challenging multi\-hop QA dataset that requires reasoning over multiple connected pieces of evidence\. This setting is suitable for evaluating whether HyCE\-RAG can organize and retrieve coherent evidence for multi\-hop reasoning\. All variants are evaluated under the same evidence budget and generation settings as the full HyCE\-RAG model\.
We compare HyCE\-RAG with the following ablated variants\.
HG\-RAG\.HG\-RAG uses the same hypergraph construction as HyCE\-RAG but removes both confidence propagation and hyperedge\-based evidence assembly\. It ranks hypergraph evidence only by initial query relevance before generation\. This variant examines whether hypergraph construction alone is sufficient for reliable multi\-hop evidence retrieval\.
w/o Confidence Propagation\.This variant removes confidence propagation over the hypergraph\. Evidence units are selected only according to their initial query relevance scores, without propagating confidence through connected entities and hyperedges\.
This reduces HyCE\-RAG to a direct relevance\-based selection strategy and evaluates whether hypergraph propagation helps recover indirect multi\-hop evidence that is not strongly matched by the query alone\.
w/o Hyperedge Evidence Assembly\.This variant removes hyperedge\-based evidence assembly\. Instead of grouping related entities and facts into evidence hyperedges, the system treats evidence units as independent textual pieces and ranks them directly according to their relevance scores\. This setting evaluates whether higher\-order evidence organization helps preserve coherent reasoning contexts for answer generation\.
Table 3:Ablation results on MuSiQue\. All values are percentages\.Acc\\mathrm\{Acc\},Rel\\mathrm\{Rel\}, andFaith\\mathrm\{Faith\}denote answer correctness, context relevance, and faithfulness, respectively\.MethodAccRelFaithHG\-RAG24\.3627\.8133\.79w/o Confidence Propagation37\.2241\.6743\.56w/o Hyperedge Evidence Assembly31\.5736\.2839\.12HyCE\-RAG56\.7357\.1679\.23
Table[3](https://arxiv.org/html/2607.22597#S4.T3)shows that removing any core component degrades the performance of HyCE\-RAG on MuSiQue\. HG\-RAG performs the worst among all variants, indicating that hypergraph construction alone is insufficient for effective multi\-hop evidence retrieval\. Although the hypergraph provides a structured representation of entities and relations, reliable reasoning still requires mechanisms that can identify structurally important evidence and assemble it into coherent contexts\.
Without confidence propagation, the model relies only on direct query–evidence relevance\. This is less effective for questions whose supporting facts are connected through intermediate entities or relations\. The result suggests that propagating confidence over the hypergraph helps identify evidence units that are not individually prominent but are structurally important for multi\-hop reasoning\.
Removing hyperedge\-based evidence assembly also leads to a substantial performance drop\. This indicates that treating evidence as isolated textual units may break the connections among related facts and produce less coherent retrieval contexts\. By grouping entities, relations, and supporting facts into hyperedges, HyCE\-RAG provides the generator with more complete evidence structures, which contributes to both answer correctness and faithfulness\.
### 4\.4Case Study
To further illustrate the reasoning behavior of HyCE\-RAG, we present a case study from the four\-hop subset of MuSiQue\.111Question ID:4hop1\_\_39871\_314549\_131976\_90181\.Each MuSiQue instance contains 20 context paragraphs, among which only 4 are supporting paragraphs and the remaining 16 are distractor paragraphs\. The question is:
> *What is the deepest part of the ocean by the state where Main Street Station is located?*
The ground\-truth answer isMilwaukee Deep\. This example requires the system to recover a four\-hop reasoning chain from the entity mentioned in the question to the relevant geographic region, the corresponding ocean, and finally its deepest point\. The setting is challenging because most context paragraphs are distractors, and some retrieved evidence is lexically related to the question but does not lie on the correct reasoning path\.
Table 4:Case study on a four\-hop MuSiQue question\. HyCE\-RAG assembles evidence chains that support the answerMilwaukee Deepwhile suppressing a structurally inconsistent chain\. Green \(red\) tags denote supporting \(contradicting\) chains\.RoleAssembled Evidence ChainScoreAnswer supportFinal answer:Milwaukee Deep
Milwaukee Deep→is\_part\_of\\xrightarrow\{\\text\{\\scriptsize is\\\_part\\\_of\}\}Atlantic Ocean→associated\_with\\xrightarrow\{\\text\{\\scriptsize associated\\\_with\}\}8,648 metres0\.8617Path supportPuerto Rico Trench→associated\_with\\xrightarrow\{\\text\{\\scriptsize associated\\\_with\}\}Atlantic Ocean→associated\_with\\xrightarrow\{\\text\{\\scriptsize associated\\\_with\}\}Caribbean Sea0\.8062Context supportAtlantic Ocean→\\rightarrowTrujillo Alto→\\rightarrowGuaynabo→\\rightarrowCarolina→\\rightarrowCaguas0\.7442DisagreementLexically related but off\-path:
G Train→stop\_at\\xrightarrow\{\\text\{\\scriptsize stop\\\_at\}\}Main Street Station→located\_in\\xrightarrow\{\\text\{\\scriptsize located\\\_in\}\}Williamsburg0\.4285This case demonstrates two key advantages of HyCE\-RAG: confidence propagation and structured evidence assembly\. First, confidence propagation enables HyCE\-RAG to move beyond direct lexical matching\. Instead of ranking evidence solely by its initial query similarity, HyCE\-RAG propagates confidence over connected entities, hyperedges, and relations\. As shown in Table[4](https://arxiv.org/html/2607.22597#S4.T4), evidence chains that are structurally consistent with the correct reasoning path receive higher propagated scores\. For instance, the chain connectingMilwaukee Deepwith theAtlantic Oceanobtains the highest score of 0\.8617, directly supporting the final answer\. The chain involving thePuerto Rico Trenchand theAtlantic Oceanalso receives a high score of 0\.8062, further reinforcing the geographic reasoning path\. In contrast, the chain involvingG TrainandWilliamsburgreceives a substantially lower score of 0\.4285\. Although this evidence is lexically related to entities in the retrieved context, it is not structurally aligned with the target ocean\-depth reasoning path\.
Second, structured evidence assembly allows HyCE\-RAG to organize scattered pieces of evidence into coherent reasoning units\. Rather than presenting isolated passages to the generator, HyCE\-RAG assembles related entities and relations into evidence chains that explicitly expose how different facts support the answer\. This organization helps the generator focus on the evidence leading toMilwaukee Deep, while reducing the influence of off\-path or conflicting evidence\. In this example, the supporting chains jointly connect the final answer, the relevant ocean, and related geographic clues, whereas theG Train–Williamsburgchain is down\-weighted because it does not contribute to the required reasoning trajectory\.
Overall, this case suggests that HyCE\-RAG not only retrieves relevant evidence, but also differentiates structurally supportive evidence from misleading or off\-path evidence\. By combining confidence propagation with evidence\-chain assembly, HyCE\-RAG provides the generator with a more reliable and interpretable context, leading to the correct answer,Milwaukee Deep\.
## 5Conclusion
We presented HyCE\-RAG, a hypergraph\-based retrieval\-augmented generation framework for complex question answering\. Instead of ranking passages independently, HyCE\-RAG models entities, relations, and evidence units within a unified hypergraph and applies confidence propagation to identify structurally coherent evidence chains\. This design helps the generator focus on evidence that is both semantically relevant and structurally supportive, while reducing the influence of off\-path distractors\.
Experiments on multi\-hop QA and GraphRAG\-Bench datasets show that HyCE\-RAG achieves stronger overall performance than competitive retrieval\-based baselines\. Averaged across the five datasets, HyCE\-RAG improves over the strongest corresponding baseline for each metric by 18\.17 percentage points in answer correctness, 8\.84 percentage points in context relevance, and 14\.56 percentage points in faithfulness\. These results indicate that hypergraph\-structured evidence organization is effective for improving both retrieval quality and answer grounding, especially in settings that require multi\-hop reasoning over dispersed evidence\.
Future work will explore more efficient hypergraph construction and extend HyCE\-RAG to broader domain\-specific and long\-context reasoning scenarios\.
## Appendix
## Appendix ADetails of Offline Hypergraph Store Construction
This appendix provides the implementation\-level details of the offline hypergraph store construction procedure described in Section[3\.2](https://arxiv.org/html/2607.22597#S3.SS2), including the record formats, canonicalization mappings, merge operations, and storage implementation\.
Each hyper\-relation record extracted from a chunk is instantiated as a hyperedge\. Specifically, a hyperedgee∈ℰ^i,ke\\in\\widehat\{\\mathcal\{E\}\}\_\{i,k\}corresponds to a self\-contained structured knowledge segment and is represented as:
e=\(seg,time,src,doc,chunk\),e=\(\\mathrm\{seg\},\\mathrm\{time\},\\mathrm\{src\},\\mathrm\{doc\},\\mathrm\{chunk\}\),\(47\)whereseg\\mathrm\{seg\}denotes the extracted knowledge segment,time\\mathrm\{time\}records temporal information if available,src\\mathrm\{src\}denotes source\-related reliability information, anddoc\\mathrm\{doc\}andchunk\\mathrm\{chunk\}indicate the source document and chunk position\. The source fields are retained as provenance information, allowing each hyperedge to be traced back to its original corpus location when needed\.
Each extracted entityv∈𝒱^i,kv\\in\\widehat\{\\mathcal\{V\}\}\_\{i,k\}is represented as:
v=\(name,type,role,alias,desc,conf\),v=\(\\mathrm\{name\},\\mathrm\{type\},\\mathrm\{role\},\\mathrm\{alias\},\\mathrm\{desc\},\\mathrm\{conf\}\),\(48\)wherename\\mathrm\{name\}is the entity name,type\\mathrm\{type\}is the entity type,role\\mathrm\{role\}describes its role in the corresponding knowledge segment,alias\\mathrm\{alias\}records possible aliases,desc\\mathrm\{desc\}provides a short textual description, andconf\\mathrm\{conf\}denotes the extraction confidence\.
The local incidence relation is created when an entity participates in a hyperedge:
\(e,v\)∈𝒜^i,kif entityvparticipates in hyperedgee\.\(e,v\)\\in\\widehat\{\\mathcal\{A\}\}\_\{i,k\}\\quad\\text\{if entity \}v\\text\{ participates in hyperedge \}e\.\(49\)Thus, a hyperedge can associate multiple entities simultaneously and preserve the higher\-order structure of an extracted knowledge segment\.
After local extraction, HyCE\-RAG merges records from different chunks into global records\. Letϕ𝒱\(⋅\)\\phi\_\{\\mathcal\{V\}\}\(\\cdot\)andϕℰ\(⋅\)\\phi\_\{\\mathcal\{E\}\}\(\\cdot\)denote the canonical mappings from local entity and hyperedge records to their merged global records:
ϕ𝒱:⋃i=1N⋃k=1mi𝒱^i,k→𝒱,ϕℰ:⋃i=1N⋃k=1miℰ^i,k→ℰ\.\\phi\_\{\\mathcal\{V\}\}:\\bigcup\_\{i=1\}^\{N\}\\bigcup\_\{k=1\}^\{m\_\{i\}\}\\widehat\{\\mathcal\{V\}\}\_\{i,k\}\\rightarrow\\mathcal\{V\},\\qquad\\phi\_\{\\mathcal\{E\}\}:\\bigcup\_\{i=1\}^\{N\}\\bigcup\_\{k=1\}^\{m\_\{i\}\}\\widehat\{\\mathcal\{E\}\}\_\{i,k\}\\rightarrow\\mathcal\{E\}\.\(50\)
The global entity set and hyperedge set are obtained as:
𝒱=\{ϕ𝒱\(v^\)∣v^∈𝒱^i,k,1≤i≤N,1≤k≤mi\},\\mathcal\{V\}=\\left\\\{\\phi\_\{\\mathcal\{V\}\}\(\\hat\{v\}\)\\mid\\hat\{v\}\\in\\widehat\{\\mathcal\{V\}\}\_\{i,k\},\\ 1\\leq i\\leq N,\\ 1\\leq k\\leq m\_\{i\}\\right\\\},\(51\)ℰ=\{ϕℰ\(e^\)∣e^∈ℰ^i,k,1≤i≤N,1≤k≤mi\}\.\\mathcal\{E\}=\\left\\\{\\phi\_\{\\mathcal\{E\}\}\(\\hat\{e\}\)\\mid\\hat\{e\}\\in\\widehat\{\\mathcal\{E\}\}\_\{i,k\},\\ 1\\leq i\\leq N,\\ 1\\leq k\\leq m\_\{i\}\\right\\\}\.\(52\)
The global incidence relation is constructed by remapping local incidence links to their corresponding global records:
𝒜=\{\(ϕℰ\(e^\),ϕ𝒱\(v^\)\)∣\(e^,v^\)∈𝒜^i,k,1≤i≤N,1≤k≤mi\}\.\\mathcal\{A\}=\\left\\\{\\left\(\\phi\_\{\\mathcal\{E\}\}\(\\hat\{e\}\),\\phi\_\{\\mathcal\{V\}\}\(\\hat\{v\}\)\\right\)\\mid\(\\hat\{e\},\\hat\{v\}\)\\in\\widehat\{\\mathcal\{A\}\}\_\{i,k\},\\ 1\\leq i\\leq N,\\ 1\\leq k\\leq m\_\{i\}\\right\\\}\.\(53\)
The corpus\-level hypergraph is therefore:
𝒢=\(𝒱,ℰ,𝒜\)\.\\mathcal\{G\}=\(\\mathcal\{V\},\\mathcal\{E\},\\mathcal\{A\}\)\.\(54\)
To construct the vector\-based entity index, the textual representation of each merged entityv∈𝒱v\\in\\mathcal\{V\}is defined as:
r\(v\)=Concat\(name,alias,type,desc\),r\(v\)=\\operatorname\{Concat\}\(\\mathrm\{name\},\\mathrm\{alias\},\\mathrm\{type\},\\mathrm\{desc\}\),\(55\)and the corresponding embedding is computed by:
𝐳v=fenc\(r\(v\)\)\.\\mathbf\{z\}\_\{v\}=f\_\{\\mathrm\{enc\}\}\(r\(v\)\)\.\(56\)These embeddings are stored in the entity indexℐ𝒱\\mathcal\{I\}\_\{\\mathcal\{V\}\}for vector\-based entity retrieval during the online stage\.
In implementation, each hyperedge is stored as a special hyperedge node and connected to its participating entity nodes through incidence links\. This design allows the hypergraph to be stored and traversed using a graph database while preserving the higher\-order structure of hyperedges\.
## Appendix BConvergence of Hypergraph Confidence Propagation
We show that the propagation process in Eq\. \([27](https://arxiv.org/html/2607.22597#S3.E27)\) converges to a unique fixed point\.
First, the transition matrix𝐒=𝐁𝐃e−1𝐁⊤𝐃v−1\\mathbf\{S\}=\\mathbf\{B\}\\mathbf\{D\}\_\{e\}^\{\-1\}\\mathbf\{B\}^\{\\top\}\\mathbf\{D\}\_\{v\}^\{\-1\}is column\-stochastic\. Let𝐝v\\mathbf\{d\}\_\{v\}and𝐝e\\mathbf\{d\}\_\{e\}denote the vertex\-degree and hyperedge\-degree vectors, respectively\. Since all isolated vertices and empty hyperedges are removed, all retained degrees are strictly positive\. Using𝟏⊤𝐁=𝐝e⊤\\mathbf\{1\}^\{\\top\}\\mathbf\{B\}=\\mathbf\{d\}\_\{e\}^\{\\top\}and𝟏⊤𝐁⊤=𝐝v⊤\\mathbf\{1\}^\{\\top\}\\mathbf\{B\}^\{\\top\}=\\mathbf\{d\}\_\{v\}^\{\\top\}, we have:
𝟏⊤𝐒\\displaystyle\\mathbf\{1\}^\{\\top\}\\mathbf\{S\}=𝟏⊤𝐁𝐃e−1𝐁⊤𝐃v−1\\displaystyle=\\mathbf\{1\}^\{\\top\}\\mathbf\{B\}\\mathbf\{D\}\_\{e\}^\{\-1\}\\mathbf\{B\}^\{\\top\}\\mathbf\{D\}\_\{v\}^\{\-1\}\(57\)=𝐝e⊤𝐃e−1𝐁⊤𝐃v−1\\displaystyle=\\mathbf\{d\}\_\{e\}^\{\\top\}\\mathbf\{D\}\_\{e\}^\{\-1\}\\mathbf\{B\}^\{\\top\}\\mathbf\{D\}\_\{v\}^\{\-1\}=𝟏⊤𝐁⊤𝐃v−1=𝐝v⊤𝐃v−1=𝟏⊤\.\\displaystyle=\\mathbf\{1\}^\{\\top\}\\mathbf\{B\}^\{\\top\}\\mathbf\{D\}\_\{v\}^\{\-1\}=\\mathbf\{d\}\_\{v\}^\{\\top\}\\mathbf\{D\}\_\{v\}^\{\-1\}=\\mathbf\{1\}^\{\\top\}\.Thus, each column of𝐒\\mathbf\{S\}sums to one\. Because𝐒\\mathbf\{S\}is nonnegative and column\-stochastic, its inducedℓ1\\ell\_\{1\}norm satisfies:
‖𝐒‖1=maxj∑i\|𝐒ij\|=1\.\\\|\\mathbf\{S\}\\\|\_\{1\}=\\max\_\{j\}\\sum\_\{i\}\|\\mathbf\{S\}\_\{ij\}\|=1\.\(58\)Therefore,
ρ\(𝐒\)≤‖𝐒‖1=1,\\rho\(\\mathbf\{S\}\)\\leq\\\|\\mathbf\{S\}\\\|\_\{1\}=1,\(59\)whereρ\(⋅\)\\rho\(\\cdot\)denotes the spectral radius\.
Next, recursively expanding Eq\. \([27](https://arxiv.org/html/2607.22597#S3.E27)\) with𝐜\(0\)=𝐫\\mathbf\{c\}^\{\(0\)\}=\\mathbf\{r\}gives:
𝐜\(K\)=λ∑k=0K−1\(1−λ\)k𝐒k𝐫\+\(1−λ\)K𝐒K𝐫\.\\mathbf\{c\}^\{\(K\)\}=\\lambda\\sum\_\{k=0\}^\{K\-1\}\(1\-\\lambda\)^\{k\}\\mathbf\{S\}^\{k\}\\mathbf\{r\}\+\(1\-\\lambda\)^\{K\}\\mathbf\{S\}^\{K\}\\mathbf\{r\}\.\(60\)The residual term vanishes asK→∞K\\rightarrow\\infty\. Indeed, since‖𝐒K‖1≤‖𝐒‖1K=1\\\|\\mathbf\{S\}^\{K\}\\\|\_\{1\}\\leq\\\|\\mathbf\{S\}\\\|\_\{1\}^\{K\}=1and‖𝐫‖1=1\\\|\\mathbf\{r\}\\\|\_\{1\}=1, we have:
‖\(1−λ\)K𝐒K𝐫‖1≤\(1−λ\)K\.\\left\\\|\(1\-\\lambda\)^\{K\}\\mathbf\{S\}^\{K\}\\mathbf\{r\}\\right\\\|\_\{1\}\\leq\(1\-\\lambda\)^\{K\}\.\(61\)Forλ∈\(0,1\]\\lambda\\in\(0,1\],0≤1−λ<10\\leq 1\-\\lambda<1, and hence:
limK→∞\(1−λ\)K=0\.\\lim\_\{K\\rightarrow\\infty\}\(1\-\\lambda\)^\{K\}=0\.\(62\)Thus, the residual term in Eq\. \([60](https://arxiv.org/html/2607.22597#A2.E60)\) disappears in the limit\.
Moreover,
ρ\(\(1−λ\)𝐒\)=\(1−λ\)ρ\(𝐒\)≤1−λ<1\.\\rho\(\(1\-\\lambda\)\\mathbf\{S\}\)=\(1\-\\lambda\)\\rho\(\\mathbf\{S\}\)\\leq 1\-\\lambda<1\.\(63\)Therefore, the Neumann series converges:
∑k=0∞\(\(1−λ\)𝐒\)k=\(𝐈−\(1−λ\)𝐒\)−1\.\\sum\_\{k=0\}^\{\\infty\}\\left\(\(1\-\\lambda\)\\mathbf\{S\}\\right\)^\{k\}=\\left\(\\mathbf\{I\}\-\(1\-\\lambda\)\\mathbf\{S\}\\right\)^\{\-1\}\.\(64\)Taking the limit of Eq\. \([60](https://arxiv.org/html/2607.22597#A2.E60)\), we obtain:
𝐜∞=λ∑k=0∞\(1−λ\)k𝐒k𝐫=λ\(𝐈−\(1−λ\)𝐒\)−1𝐫\.\\mathbf\{c\}^\{\\infty\}=\\lambda\\sum\_\{k=0\}^\{\\infty\}\(1\-\\lambda\)^\{k\}\\mathbf\{S\}^\{k\}\\mathbf\{r\}=\\lambda\\left\(\\mathbf\{I\}\-\(1\-\\lambda\)\\mathbf\{S\}\\right\)^\{\-1\}\\mathbf\{r\}\.\(65\)
Finally, this limit is the unique fixed point\. If𝐜\\mathbf\{c\}is a fixed point, then:
𝐜=λ𝐫\+\(1−λ\)𝐒𝐜\.\\mathbf\{c\}=\\lambda\\mathbf\{r\}\+\(1\-\\lambda\)\\mathbf\{S\}\\mathbf\{c\}\.\(66\)Rearranging gives:
\(𝐈−\(1−λ\)𝐒\)𝐜=λ𝐫\.\\left\(\\mathbf\{I\}\-\(1\-\\lambda\)\\mathbf\{S\}\\right\)\\mathbf\{c\}=\\lambda\\mathbf\{r\}\.\(67\)Sinceρ\(\(1−λ\)𝐒\)<1\\rho\(\(1\-\\lambda\)\\mathbf\{S\}\)<1, the matrix𝐈−\(1−λ\)𝐒\\mathbf\{I\}\-\(1\-\\lambda\)\\mathbf\{S\}is invertible\. Therefore, the fixed point is unique and equals:
𝐜=λ\(𝐈−\(1−λ\)𝐒\)−1𝐫=𝐜∞\.\\mathbf\{c\}=\\lambda\\left\(\\mathbf\{I\}\-\(1\-\\lambda\)\\mathbf\{S\}\\right\)^\{\-1\}\\mathbf\{r\}=\\mathbf\{c\}^\{\\infty\}\.\(68\)
## Appendix CHyperparameter Settings
We use a fixed set of hyperparameters for HyCE\-RAG across all test examples\. The core settings are summarized in Table[5](https://arxiv.org/html/2607.22597#A3.T5)\. Unless otherwise specified, these hyperparameters are kept unchanged for all datasets and queries\.
HyperparameterValueNumber of entry entities5Expansion hops4Propagation steps10Selected evidence units15Final context evidence segments6
Table 5:Core hyperparameter settings used for HyCE\-RAG in our experiments\.
For each question, HyCE\-RAG retrieves up to 5 entry entities and expands the hypergraph for 4 hops to collect query\-relevant entities and hyperedges\. It then performs 10 confidence propagation steps over the query\-aware hypergraph\. After evidence scoring and assembly, the top 15 evidence units are retained as the selected evidence set\. For answer generation, the final context is capped at 6 evidence segments to keep the evidence budget comparable across retrieval\-based methods\.
## ReferencesSimilar Articles
A Unified Framework for Context-Aware and Relation-Aware Graph Retrieval-Augmented Generation
This paper proposes HyGRAG, a hierarchical graph RAG framework that integrates contextual and relational information for multi-hop reasoning, achieving a 9.7% average accuracy improvement over existing methods.
DynaKRAG: A Unified Framework for Learnable Evidence Control in Multi-Hop Retrieval-Augmented Generation
DynaKRAG introduces a unified framework for multi-hop retrieval-augmented generation that learns a state-conditioned policy to select evidence operations, outperforming baselines on HotpotQA, 2Wiki, and MuSiQue.
GRACE-RAG: Governed Retrieval Architecture for Canonical Evidence Synthesis, Enabling Lightweight Deployment in Closed-Domain Institutional Settings
This paper introduces GRACE-RAG, a retrieval-governed, graph-augmented RAG architecture that externalizes structural reasoning from generation to a structured retrieval layer, enabling lightweight deployment in closed-domain institutional settings. Experiments show up to 20% quality gains with mid-scale models, reducing computational and latency footprint.
ContextRAG: Extraction-Free Hierarchical Graph Construction for Retrieval-Augmented Generation
ContextRAG introduces an extraction-free method for constructing hierarchical graph indices for retrieval-augmented generation, using Residual-Quantization K-Means and Formal Concept Analysis to reduce LLM calls and tokens by orders of magnitude while maintaining competitive F1 scores on multi-hop questions.
Why Retrieval-Augmented Generation Fails: A Graph Perspective
This paper investigates why Retrieval-Augmented Generation (RAG) systems fail despite having access to correct evidence. Using circuit tracing and attribution graphs, the authors find that correct predictions exhibit deeper reasoning paths and more distributed evidence flow, while failures show shallow and fragmented patterns. They propose a graph-based error detection framework and targeted interventions to improve RAG reliability.