Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergy

# Cognition on Graph: Navigating Massive Knowledge Space via Cognitive Cycles and Bidirectional Graph-Text Synergy
Source: [https://arxiv.org/html/2609.12791](https://arxiv.org/html/2609.12791)
Gengxian ZhouAffiliation:Beijing University of Posts and TelecommunicationsAffiliation:Zhongguancun Academy, BeijingEmail:[liucl@nlpr\.ia\.ac\.cn](mailto:)Jian XuAffiliation:MAIS, Institute of Automation, Chinese Academy of SciencesAffiliation:School of Artificial Intelligence, University of Chinese Academy of SciencesCorrespondence:ehaihong@bupt\.edu\.cnShiming XiangAffiliation:MAIS, Institute of Automation, Chinese Academy of SciencesAffiliation:School of Artificial Intelligence, University of Chinese Academy of SciencesCorrespondence:ehaihong@bupt\.edu\.cnHaihong E††thanks:Corresponding authors\.Affiliation:Beijing University of Posts and TelecommunicationsCheng\-Lin Liu11footnotemark:1Affiliation:Zhongguancun Academy, BeijingAffiliation:MAIS, Institute of Automation, Chinese Academy of SciencesAffiliation:School of Artificial Intelligence, University of Chinese Academy of SciencesCorrespondence:ehaihong@bupt\.edu\.cn

###### Abstract

Retrieval\-Augmented Generation \(RAG\) has empowered Large Language Models \(LLMs\) to tackle knowledge\-intensive tasks\. However, navigating global, heterogeneous knowledge bases \(large\-scale knowledge graphs and text corpora\) for complex reasoning remains a challenge\. Existing methods typically employ reactive, graph\-driven exploration strategies, which blindly follow graph topology without adapting to the question context or evolving exploration progress, and lack deep bidirectional synergy between graph and text\. To address these limitations, we propose CoG \(Cognition on Graph\), a cognitive\-inspired, training\-free framework for adaptive knowledge exploration\. Drawing inspiration from human problem\-solving, CoG performs a continuousplan\-explore\-reflectcycle, where it proactively formulates investigation plans, performs dual\-source retrieval, and dynamically reflects on progress to adjust strategies\. Crucially, it establishes deep bidirectional synergy between structured graph and unstructured text, where entities extracted from text dynamically guide graph exploration to bridge knowledge gaps\. Extensive experiments on seven multi\-hop QA benchmarks demonstrate that CoG significantly outperforms state\-of\-the\-art methods while achieving superior exploration efficiency\. Our code and datasets are available at[https://github\.com/zhougengxian/CoG](https://github.com/zhougengxian/CoG)\.

## 1Introduction

While Large Language Models \(LLMs\) excel in various tasks, their reliance on static parametric knowledge causes factual hallucinations and opaque reasoning in knowledge\-intensive scenarios[Huang et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib13);[Li et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib22);[Wang et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib39)\. Retrieval\-Augmented Generation \(RAG\) mitigates this by grounding response in external knowledge sources to improve accuracy and traceability[Zhang et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib52);[Song et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib30)\.

![Refer to caption](https://arxiv.org/html/2609.12791v1/method_comparison.png)Figure 1:Comparison of exploration strategies\. CoG integrates all prior capabilities in a cognitive cycle, uniquely establishing a bidirectional synergy where text actively bridges graph gaps, enabling robust navigation in global knowledge bases\.Effective retrieval is the core of RAG\. VectorRAG[Lewis et al\. \(2020\)](https://arxiv.org/html/2609.12791#bib.bib18)retrieves text chunks via vector similarity, while GraphRAG[Gutiérrez et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib9);[Luo et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib25);[Gutiérrez et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib10);[Yang et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib45);[Wu et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib43);[Dong et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib6)constructs Knowledge Graphs \(KGs\) for structural guidance\. However, existing methods predominantly operate in simplified, local settings\. They restrict the knowledge scope to pre\-selected oracle paragraphs known to contain answers, rather than raw, complete entity documents\. This masks the inherent noise of real\-world retrieval, failing to assess true robustness[Luo et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib26)\.

When transitioning to the global setting, the core challenge escalates from simple information retrieval to complex knowledge exploration\. It requires systems to progressively construct evidence chains by synthesizing structural associations from KGs and semantic information from text corpora\. Throughout this process, the systems must effectively navigate the noise, ambiguity and distractions inherent in large\-scale knowledge bases\.

Existing works attempting to address this challenge, however, fall short in two critical aspects \(illustrated in Figure[1](https://arxiv.org/html/2609.12791#S1.F1)\)\. First, exploration remains heavilyKG\-dependentwithinsufficient text utilization\. Most methods rely solely on KG traversal for exploration[Sun et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib31);[Chen et al\. \(2024b\)](https://arxiv.org/html/2609.12791#bib.bib3);[Ma et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib27);[Wang et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib38)\. Even hybrid methods[Ma et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib28)merely use text as auxiliary context, failing to leverage entities within text to actively guide the exploration, leaving the inherent sparsity and incompleteness of KGs unaddressed\. Second, the exploration strategies arefragile and rigid\. Relying on pre\-annotated entities as rigid starting points[Xu et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib44)and lacking mechanisms for backtracking[Chen et al\. \(2024b\)](https://arxiv.org/html/2609.12791#bib.bib3)or proactive adjustment[Ma et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib27), these systems are prone to getting lost in irrelevant subgraphs or stranded by linking failures or knowledge gaps\.

To bridge these gaps, we draw inspiration from the cognitive process of human problem\-solving\. Facing complex questions in open domains, humans do not blindly traverse information; instead, they engage in a dynamic cycle of planning, exploration, and reflection\. They proactively formulate investigation plans, flexibly synthesize information from diverse sources, and continuously reflect on accumulated evidence to adjust their strategy\.

Guided by this mechanism, we propose CoG \(Cognition on Graph\), a framework that instantiates this human\-like reasoning process into a continuous cognitive loop comprising Planning, Exploration, Synthesis, and Reflection\. In thePlanningphase, instead of relying on pre\-annotated entities, CoG proactively analyzes the question to formulate an investigation strategy, from which it derives exploratory sub\-queries and identifies relevant entities to anchor the search\. During theExplorationphase, CoG performs dual\-source knowledge gathering\. It retrieves 1\-hop relevant subgraphs from the KG while simultaneously conducting hierarchical reading of entity\-related documents in the text corpus, capturing both structural relations and rich contextual details\. TheSynthesismodule then aggregates evidence from both sources into a unified retrieval summary, distilling key insights that advance the reasoning process and achieving deep bidirectional synergy between structured and unstructured knowledge\. Finally, theReflectionmodule evaluates the utility of the retrieved information: for productive explorations, it updates the strategy and generates the next query based on the progress made; for unproductive ones, it diagnoses the failure using the global interaction history and adjusts the course, ensuring robust navigation through vast knowledge spaces\.

Our main contributions are threefold:

- •We propose CoG, a cognitive\-inspired, closed\-loop, training\-free GraphRAG framework\. It leverages continuous cognitive cycles of plan\-explore\-reflect foradaptive knowledge explorationin noisy global knowledge bases\.
- •We establish deepbidirectional synergybetween structured and unstructured knowledge, where entities dynamically extracted from text actively guide graph exploration to effectively address KG incompleteness\.
- •Extensive experiments on seven knowledge\-intensive, multi\-hop QA benchmarks demonstrate that CoG significantly outperforms state\-of\-the\-art methods, showcasing superior reasoning capability and robustness in navigating large\-scale knowledge bases\.

## 2Related Work

MethodScopeText CorpusKnowledge GraphKey CapabilitiesExploration Strategy\#Words\#Ent\.Source\#Ent\.\#Trip\.TextGuideRefl\.& Bk\.Pro\.Plan\.Adapt\.EL\.VectorRAGLocal1\.5M21K–––––––Dense RetrievalGraphRAG Series†Local0\.9M12KConstr\.‡97K1\.4M––––Graph\-Guided RetrievalStructGPT, KG\-AgentGlobal––Freebase39M1\.9B✗✗✗✗Interaction HistoryToG, ReKnoSGlobal––Wikidata115M1\.7B✗✗✗✗Beam SearchPoGGlobal––Freebase39M1\.9B✗✓✗✗Beam Search w/ BacktrackDoGGlobal––Freebase39M1\.9B✗✗✓✗Multi\-Agent DebateAnchorRAGGlobal––Freebase39M1\.9B✗✗✗✓Parallel Anchor ExplorationKERAGGlobal––Wikidata115M1\.7B✗✗✗✓Schema\-Guided ExpansionToG\-2Global5B7\.1MWikidata115M1\.7B✗✗✗✗Beam SearchCoG \(Ours\)Global5B7\.1MWikidata115M1\.7B✓✓✓✓Cognitive Cycle

Table 1:Comparison of retrieval and exploration methods\. We report knowledge base scales as totalWordsandEntity documents for Text, versusEntities andTriples for KG \(Units: K=Thousand, M=Million, B=Billion\)\.CoGuniquely operates on a massive scale while integrating all key exploration capabilities:Text Guide\(Text entity guides graph exploration\),Refl\. & Bk\.\(Reflection & Backtrack\),Pro\. Plan\.\(Proactive planning\), andAdapt\. EL\.\(Adaptive entity linking\)\.†\\dagger: Includes HippoRAG, HippoRAG2, GFM\-RAG, et al\.‡\\ddagger: Graphs constructed from local text corpora\. ✓: Present, ✗: Absent, “–”: not applicable\.RAG enhances LLMs by retrieving external knowledge\. Beyond VectorRAG[Lewis et al\. \(2020\)](https://arxiv.org/html/2609.12791#bib.bib18), GraphRAG methods construct structured indices like knowledge graphs[Gutiérrez et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib10);[Guo et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib8);[Gutiérrez et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib9);[Zhu et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib54), hierarchical communities[Edge et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib7);[Huang et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib12), or document graphs[Wang et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib41);[Chen et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib4);[Li et al\. \(2024a\)](https://arxiv.org/html/2609.12791#bib.bib19)to guide retrieval\. Recent advancements employ reinforcement learning[Luo et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib24);[Yu et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib50)or hybrid dense retrieval[Lei et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib17)over graphs\. However, these works primarily operate in local settings, restricting the knowledge base to highly relevant oracle documents or domain\-specific KGs\. This simplifies the exploration challenge, failing to assess robustness in noisy global environments\. In contrast, CoG addresses the realistic and massive scale of global knowledge bases \(Wikidata and Wikipedia\), navigating an exponentially larger and noisier search space\.

For global knowledge exploration, prior works focus on iterative KG reasoning\. Path\-based methods like ToG[Sun et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib31), StructGPT[Jiang et al\. \(2023\)](https://arxiv.org/html/2609.12791#bib.bib14), and KG\-Agent[Jiang et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib15)perform prompt\-driven exploration, while ReKnoS[Wang et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib38)and KERAG[Sun et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib32)improve coverage via super\-relations or schemas\. Strategy\-based methods introduce specific heuristics, such as backtracking in PoG[Chen et al\. \(2024b\)](https://arxiv.org/html/2609.12791#bib.bib3)or multi\-agent debate and parallelism in DoG[Ma et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib27)and AnchorRAG[Xu et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib44)\. However, these approaches treat advanced reasoning behaviors as fragmented add\-ons to fixed pipelines\. Meanwhile, learning\-based methods[Chang et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib1);[Lin et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib23);[Cui et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib5)train specialized navigation modules, introducing high training costs and instability while lacking explicit interpretability\. Distinguishing itself from these rigid pipelines and costly training, CoG introduces a training\-free, closed\-loop cognitive cycle\. It natively unifies “plan\-explore\-reflect”, enabling proactive planning and adaptive error\-correction to emerge autonomously\.

Despite advanced reasoning, KG\-centric methods remain vulnerable to KG sparsity and incompleteness\. To address this, hybrid methods integrate KGs with text corpora[Lee et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib16);[Sarmah et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib29);[Tan et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib34)\. CoK[Li et al\. \(2024b\)](https://arxiv.org/html/2609.12791#bib.bib21)verifies reasoning across multi\-source bases, while ToG\-2[Ma et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib28)uses graph entities to anchor document retrieval\. Other approaches utilize text merely for relevance scoring[Lei et al\. \(2025\)](https://arxiv.org/html/2609.12791#bib.bib17)or rely on pre\-constructed hyperedges[Luo et al\. \(2026\)](https://arxiv.org/html/2609.12791#bib.bib24)\. However, these methods treat text as passive context or require rigid offline constructions, lacking dynamic structural guidance\. In contrast, CoG introduces a deep bidirectional synergy where unstructured text actively guides graph traversal\. By extracting entities from text to dynamically bridge KG structural gaps, it achieves robust exploration in noisy global spaces\.

Table[1](https://arxiv.org/html/2609.12791#S2.T1)provides a systematic comparison of these methods across key capabilities\.

## 3Method

### 3\.1Task Definition

![Refer to caption](https://arxiv.org/html/2609.12791v1/method_framework.png)Figure 2:Overview of the CoG framework\. It employs a continuous cognitive cycle of plan\-explore\-reflect to adaptively navigate structured and unstructured knowledge for complex QA\.We focus on the task of multi\-hop Question Answering \(QA\) over a global, hybrid knowledge base\. Given a complex questionqq, the system must construct an evidence chain by iteratively retrieving and reasoning over heterogeneous knowledge sources to generate the final answeraa\.

The knowledge base𝒦=\{𝒢,𝒟\}\\mathcal\{K\}=\\\{\\mathcal\{G\},\\mathcal\{D\}\\\}comprises two complementary components:

Structured Knowledge Graph𝒢=\(ℰ,ℛ,𝒯\)\\mathcal\{G\}=\(\\mathcal\{E\},\\mathcal\{R\},\\mathcal\{T\}\), whereℰ\\mathcal\{E\}andℛ\\mathcal\{R\}denote the sets of entities and relations\. The KG provides structured information in two forms: 1\) relational fact triples𝒯=\{\(h,r,t\)∣h,t∈ℰ,r∈ℛ\}\\mathcal\{T\}=\\\{\(h,r,t\)\\mid h,t\\in\\mathcal\{E\},r\\in\\mathcal\{R\}\\\}that connect pairs of entities, and 2\) entity attributes \(e\.g\., date of birth, gender\) that describe the properties of individual entities\.

Unstructured Text Corpus𝒟\\mathcal\{D\}, a large\-scale collection of documents\. Each documentd∈𝒟d\\in\\mathcal\{D\}corresponds to an entity and is hierarchically structured, containing a summary paragraph, a table of contents, and the full text organized into sections\. It provides rich, fine\-grained semantic descriptions that complement the factual statements in𝒢\\mathcal\{G\}\.

### 3\.2CoG Framework

Figure[2](https://arxiv.org/html/2609.12791#S3.F2)illustrates the overall architecture of CoG\. Given a questionqq, CoG iteratively executes a cognitive cycle until sufficient evidence is gathered to generate an answer\. Each cycle consists of four tightly integrated phases: \(1\) Planning formulates an investigation strategy and generates a sub\-query; \(2\) Exploration retrieves evidence from both KG and text; \(3\) Synthesis aggregates and distills the retrieved information; \(4\) Reflection evaluates progress and decides the next action\.

Throughout this process, CoG maintains three long\-term memory components to enable coherent multi\-turn reasoning: aNotebook𝒩\\mathcal\{N\}to accumulate verified facts, aCandidate Entity Pool𝒫\\mathcal\{P\}to manage promising but deferred exploration leads, and anInteraction Historyℋ\\mathcal\{H\}to enable global reflection and strategic adjustment\.

#### 3\.2\.1Planning

The Planning Module proactively analyzes the question and formulates an initial exploration strategy\. Unlike methods that rely on pre\-annotated entities, CoG dynamically derives a strategic plan directly from the questionqq\. This process comprises three key components:

Question Analysis\.It analyzes the questionqqto identify information needs and reasoning dependencies, determining what knowledge must be gathered first\. This analysisA0A\_\{0\}serves as a high\-level guide for subsequent actions\.

Query Decomposition\.Based on the analysis, the question is decomposed into a set of focused sub\-queriesQ0=\{q1\(0\),…,qB\(0\)\}Q\_\{0\}=\\\{q\_\{1\}^\{\(0\)\},\\dots,q\_\{B\}^\{\(0\)\}\\\}, each targeting a specific information need that can be explored independently as the immediate next step\.

Entity Identification\.It identifies a list of anchor entitiesE0=\{e1\(0\),…,eB\(0\)\}E\_\{0\}=\\\{e\_\{1\}^\{\(0\)\},\\dots,e\_\{B\}^\{\(0\)\}\\\}corresponding one\-to\-one withQ0Q\_\{0\}\. Eachei\(0\)e\_\{i\}^\{\(0\)\}serves as the core anchor point for initiating the exploration of queryqi\(0\)q\_\{i\}^\{\(0\)\}in both the KG and text corpus\.

Formally, the initial planP0P\_\{0\}is generated by:

P0=\(A0,Q0,E0\)=Promptinit​\(q,LLM\)\.P\_\{0\}=\(A\_\{0\},Q\_\{0\},E\_\{0\}\)=\\text\{Prompt\}\_\{\\text\{init\}\}\(q,\\text\{LLM\}\)\.\(1\)
The prompt is provided in Appendix[K](https://arxiv.org/html/2609.12791#A11), Table[16](https://arxiv.org/html/2609.12791#A11.T16)\.

#### 3\.2\.2Exploration

Given a sub\-queryqi\(t\)q\_\{i\}^\{\(t\)\}and its anchor entityei\(t\)e\_\{i\}^\{\(t\)\}from the Planning phase, the Exploration module performsdual\-source retrievalto gather complementary evidence from both the structured KG𝒢\\mathcal\{G\}and the unstructured text corpus𝒟\\mathcal\{D\}\.

##### KG Exploration\.

To navigate massive global KGs with inherent ambiguity and noise, we design a three\-stage pipeline that progressively narrows the search scope from entity disambiguation to relation filtering and fine\-grained fact pruning\.

\(1\) Entity Linking\.We design a context\-aware coarse\-to\-fine recall strategy\. First, we retrieve top\-kkcandidate entities𝒞\\mathcal\{C\}via vector similarity between the query contextCi\(t\)=\(q,At,qi\(t\),ei\(t\)\)C\_\{i\}^\{\(t\)\}=\(q,A\_\{t\},q\_\{i\}^\{\(t\)\},e\_\{i\}^\{\(t\)\}\)and entity profiles \(aliases, description and neighbors\)\. Then, the LLM performs precise disambiguation by evaluating each candidate’s profile against the query context to determine the optimal match:

𝒞\\displaystyle\\mathcal\{C\}=VectorRecall​\(Ci\(t\),ℰ,k\),\\displaystyle=\\text\{VectorRecall\}\(C\_\{i\}^\{\(t\)\},\\mathcal\{E\},k\),e∗\\displaystyle e^\{\*\}=Promptlink​\(Ci\(t\),𝒞,LLM\)\.\\displaystyle=\\text\{Prompt\}\_\{\\text\{link\}\}\(C\_\{i\}^\{\(t\)\},\\mathcal\{C\},\\text\{LLM\}\)\.\(2\)
\(2\) Relation Discovery\.First, we retrieve all relationsReR\_\{e\}connected to the linked entitye∗e^\{\*\}\. Then, the LLM selects a subsetRsel⊂ReR\_\{\\text\{sel\}\}\\subset R\_\{e\}relevant to the query contextCi\(t\)C\_\{i\}^\{\(t\)\}by considering relation labels, connectivity and potential to lead toward the answer, thereby pruning the search space at the schema level:

Re∗\\displaystyle R\_\{e^\{\*\}\}=GetRelations​\(e∗,𝒢\),\\displaystyle=\\text\{GetRelations\}\(e^\{\*\},\\mathcal\{G\}\),Rsel\\displaystyle R\_\{\\text\{sel\}\}=Promptrel​\(Ci\(t\),e∗,Re∗,LLM\)\.\\displaystyle=\\text\{Prompt\}\_\{\\text\{rel\}\}\(C\_\{i\}^\{\(t\)\},e^\{\*\},R\_\{e^\{\*\}\},\\text\{LLM\}\)\.\(3\)
\(3\) Fact Pruning\.We retrieve all factsFr​a​wF\_\{raw\}\(triples and attributes\) associated with the selected relationsRselR\_\{\\text\{sel\}\}\. The LLM performs fine\-grained pruning to retain only facts that either directly answer the queryqi\(t\)q\_\{i\}^\{\(t\)\}or serve as promising stepping stones for further exploration, filtering out noise while preserving critical evidence:

Fr​a​w\\displaystyle F\_\{raw\}=\{\(e∗,r,t\)∈𝒯∣r∈Rsel,t∈ℰ\}\\displaystyle=\\\{\(e^\{\*\},r,t\)\\in\\mathcal\{T\}\\mid r\\in R\_\{\\text\{sel\}\},t\\in\\mathcal\{E\}\\\}∪\{\(h,r,e∗\)∈𝒯∣r∈Rsel,h∈ℰ\},\\displaystyle\\quad\\cup\\\{\(h,r,e^\{\*\}\)\\in\\mathcal\{T\}\\mid r\\in R\_\{\\text\{sel\}\},h\\in\\mathcal\{E\}\\\},FiK​G\\displaystyle F\_\{i\}^\{KG\}=Promptfact​\(Ci\(t\),Fr​a​w,LLM\)\.\\displaystyle=\\text\{Prompt\}\_\{\\text\{fact\}\}\(C\_\{i\}^\{\(t\)\},F\_\{raw\},\\text\{LLM\}\)\.\(4\)

##### Text Exploration\.

We propose a hierarchical reading strategy that mimics human reading behavior, narrowing the focus from document retrieval to global skimming and fine\-grained section analysis, balancing retrieval efficiency with depth\.

\(1\) Adaptive Page Selection\.We employ an adaptive mechanism to retrieve the optimal entity documentdid\_\{i\}forei\(t\)e\_\{i\}^\{\(t\)\}\. When encountering disambiguation or missing pages, the LLM progressively refines the search query by analyzing query contextCi\(t\)C\_\{i\}^\{\(t\)\}and Wikipedia API feedback, ensuring robust page localization despite real\-world noise\.

\(2\) Global Skimming\.The LLM skims the high\-level structure of the retrieved pagedid\_\{i\}\( summary, table of contents and infobox\) to assess the page’s relevance to the query contextCi\(t\)C\_\{i\}^\{\(t\)\}and extract useful evidenceIs​k​i​mI\_\{skim\}\. If deeper investigation is needed, it selects a focused subset of promising sectionsSs​e​lS\_\{sel\}likely to contain missing details:

Ss​e​l,Is​k​i​m=Promptskim​\(Ci\(t\),di,LLM\)\.S\_\{sel\},I\_\{skim\}=\\text\{Prompt\}\_\{\\text\{skim\}\}\(C\_\{i\}^\{\(t\)\},d\_\{i\},\\text\{LLM\}\)\.\(5\)
\(3\) Detailed Reading\.For each selected sections∈Ss​e​ls\\in S\_\{sel\}, we retrieve its full content, split it into chunks, and identify the top\-kkrelevant chunks via dense retrieval\. Concurrently, tables within the section are extracted and serialized\. Finally, the LLM performs joint analysis of text chunks and tables to synthesize fine\-grained evidenceId​e​t​a​i​lsI\_\{detail\}^\{s\}:

Id​e​t​a​i​l\(s\)=Promptdetail​\(Ci\(t\),s,LLM\)\.I\_\{detail\}^\{\(s\)\}=\\text\{Prompt\}\_\{\\text\{detail\}\}\(C\_\{i\}^\{\(t\)\},s,\\text\{LLM\}\)\.\(6\)
Combining skimmed and detailed extractions, the final text evidence for entityei\(t\)e\_\{i\}^\{\(t\)\}isFit​e​x​t=Is​k​i​m∪\{Id​e​t​a​i​l\(s\)∣s∈Ss​e​l\}F\_\{i\}^\{text\}=I\_\{skim\}\\cup\\\{I\_\{detail\}^\{\(s\)\}\\mid s\\in S\_\{sel\}\\\}\.

##### Dual\-Source Evidence\.

The final retrieved evidence for sub\-queryqi\(t\)q\_\{i\}^\{\(t\)\}is the aggregation of dual\-source knowledge:Ki\(t\)=FiK​G∪Fit​e​x​tK\_\{i\}^\{\(t\)\}=F\_\{i\}^\{KG\}\\cup F^\{text\}\_\{i\}\.

Prompts for KG \(Tables[17](https://arxiv.org/html/2609.12791#A11.T17)–[20](https://arxiv.org/html/2609.12791#A11.T20)\) and text \(Tables[21](https://arxiv.org/html/2609.12791#A11.T21)–[24](https://arxiv.org/html/2609.12791#A11.T24)\) exploration are provided in Appendix[K](https://arxiv.org/html/2609.12791#A11)\.

#### 3\.2\.3Synthesis & Reflection

TheSynthesismodule aggregates dual\-source evidence and evaluates progress\. We design structured formats to present KG and text retrievalKt=\{K1\(t\),…,KB\(t\)\}K\_\{t\}=\\\{K\_\{1\}^\{\(t\)\},\\dots,K\_\{B\}^\{\(t\)\}\\\}\. The LLM first distills key facts and promising leads into a unified retrieval summaryMtM\_\{t\}, achieving deep synergy between structured KG and unstructured text\. Simultaneously, it makes a judgmentJtJ\_\{t\}based on the notebook𝒩\\mathcal\{N\}and the current planPt=\(At,Qt,Et\)P\_\{t\}=\(A\_\{t\},Q\_\{t\},E\_\{t\}\)to determine whether to generate the final answer, continue exploration, or adjust the strategy:

Jt,Mt=Promptsyn​\(q,Pt,Kt,𝒩,LLM\)\.J\_\{t\},M\_\{t\}=\\text\{Prompt\}\_\{\\text\{syn\}\}\(q,P\_\{t\},K\_\{t\},\\mathcal\{N\},\\text\{LLM\}\)\.\(7\)
Depending onJtJ\_\{t\}, theReflectionmodule dynamically directs exploration through two pathways:

\(1\) Continue Exploration\.When progress is made but evidence remains incomplete, it refines the analysis to reflect new findings, formulates a new planPt\+1P\_\{t\+1\}targeting remaining knowledge gaps\. Simultaneously, it updates two long\-term memory structures: Notebook𝒩\\mathcal\{N\}, which accumulates verified key facts directly relevant toqq, and Candidate Entity Pool𝒫\\mathcal\{P\}, which stores promising but deferred entities due to exploration width constraints:

Pt\+1,𝒩,𝒫=Promptcont​\(q,Pt,Mt,𝒩,𝒫,LLM\)\.P\_\{t\+1\},\\mathcal\{N\},\\mathcal\{P\}=\\text\{Prompt\}\_\{\\text\{cont\}\}\(q,P\_\{t\},M\_\{t\},\\mathcal\{N\},\\mathcal\{P\},\\text\{LLM\}\)\.\(8\)
\(2\) Strategy Adjustment\.When facing dead ends, it performs critical reflection by analyzing the global interaction historyℋ\\mathcal\{H\}to diagnose strategic errors\. Then it pivots the strategy by backtracking to deferred entities in𝒫\\mathcal\{P\}or reformulating queries from entirely new angles based on theqqand current progress, thereby ensuring resilient exploration:

Pt\+1,𝒫=Promptrecov​\(q,Pt,Mt,ℋ,𝒩,𝒫,LLM\)\.P\_\{t\+1\},\\mathcal\{P\}=\\text\{Prompt\}\_\{\\text\{recov\}\}\(q,P\_\{t\},M\_\{t\},\\mathcal\{H\},\\mathcal\{N\},\\mathcal\{P\},\\text\{LLM\}\)\.\(9\)
Interaction History Update\.After each turn, the system appends the current retrieval summaryMtM\_\{t\}and planPtP\_\{t\}to the interaction history:ℋ←ℋ∪\{\(Pt,Mt\)\}\\mathcal\{H\}\\leftarrow\\mathcal\{H\}\\cup\\\{\(P\_\{t\},M\_\{t\}\)\\\}\. This cumulative memory enables global retrospection, allowing the system to avoid repeating failed strategies and to make globally informed decisions across multiple turns\.

Prompts for synthesis \(Table[25](https://arxiv.org/html/2609.12791#A11.T25)\) and reflection \(Tables[28](https://arxiv.org/html/2609.12791#A11.T28),[29](https://arxiv.org/html/2609.12791#A11.T29)\) are provided in Appendix[K](https://arxiv.org/html/2609.12791#A11)\.

#### 3\.2\.4Overall Workflow & Answer Generation

CoG executes the aforementioned cognitive cycle iteratively, until the Reflection module deems the evidence sufficient or a maximum turn limit is reached\. The complete algorithmic workflow is detailed in Algorithm[1](https://arxiv.org/html/2609.12791#alg1)in Appendix[A](https://arxiv.org/html/2609.12791#A1)\.

Upon sufficiency, the system synthesizes accumulated facts in Notebook𝒩\\mathcal\{N\}and final retrieval resultMtM\_\{t\}\. The LLM constructs a comprehensive reasoning chain connecting these facts to directly address the question, producing the final answeraa\.

## 4Experiments

### 4\.1Experimental Setup

##### Datasets\.

We evaluate on seven knowledge\-intensive multi\-hop QA benchmarks: \(1\) KG\-based QA: KGQAGen[Zhang et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib51), CWQ[Talmor and Berant \(2018\)](https://arxiv.org/html/2609.12791#bib.bib33), QALD10\-en[Usbeck et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib37), and WebQSP[Yih et al\. \(2016\)](https://arxiv.org/html/2609.12791#bib.bib49), which require reasoning over structured facts for entity\-centric answers\. \(2\) Text\-based QA: 2WikiMQA[Ho et al\. \(2020\)](https://arxiv.org/html/2609.12791#bib.bib11), AdvHotpotQA[Ye and Durrett \(2022\)](https://arxiv.org/html/2609.12791#bib.bib48), and MusiQue[Trivedi et al\. \(2022\)](https://arxiv.org/html/2609.12791#bib.bib35), which demand deep semantic understanding and multi\-document synthesis for span extraction and free\-form answer generation\. Detailed descriptions and statistics are provided in Appendix[B](https://arxiv.org/html/2609.12791#A2)\. We use Exact Match \(EM\) as the primary evaluation metric following previous work[Ma et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib28), and additionally report token\-level F1 and reference\-based LLM\-as\-judge results in Appendix[D](https://arxiv.org/html/2609.12791#A4)\. For repeated runs, we report the median of three independent runs to ensure robustness\.

##### Baselines\.

We compare CoG against representative methods across four categories: \(1\) LLM\-only: Direct few\-shot prompting, Chain\-of\-Thought[Wei et al\. \(2022\)](https://arxiv.org/html/2609.12791#bib.bib42), and Self\-Consistency[Wang et al\. \(2023\)](https://arxiv.org/html/2609.12791#bib.bib40), relying solely on internal parametric knowledge; \(2\) Text\-based RAG: VectorRAG \(top\-33chunk dense retrieval\), ReAct[Yao et al\. \(2023\)](https://arxiv.org/html/2609.12791#bib.bib47)and IRCoT[Trivedi et al\. \(2023\)](https://arxiv.org/html/2609.12791#bib.bib36)for iterative text exploration, and Search\-o1[Li et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib20)for on\-demand retrieval during reasoning; \(3\) KG\-based RAG: ToG[Sun et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib31)for iterative KG traversal, PoG[Chen et al\. \(2024b\)](https://arxiv.org/html/2609.12791#bib.bib3)with backtracking, and DoG[Ma et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib27)using debate\-driven query evolution; \(4\) Hybrid RAG: ToG\-2[Ma et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib28), the current state\-of\-the\-art framework combining KG traversal with text retrieval under the same global knowledge setting as CoG\.

##### Implementation Details\.

Following previous works[Ma et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib28);[Li et al\. \(2024b\)](https://arxiv.org/html/2609.12791#bib.bib21), we adopt the global knowledge setting, utilizing the full Wikidata and Wikipedia as structured and unstructured knowledge bases, respectively \(details in Appendix[C](https://arxiv.org/html/2609.12791#A3)\)\. This setting presents a realistic and challenging environment compared to simplified local settings\. We employ Qwen3\-32B \(non\-thinking mode\) as the backbone LLM for CoG and baselines to ensure fair comparison\. For retrieval, we utilize bge\-m3[Chen et al\. \(2024a\)](https://arxiv.org/html/2609.12791#bib.bib2)as the embedding model for text chunk retrieval, and Qwen3\-Embedding\-4B[Zhang et al\. \(2025c\)](https://arxiv.org/html/2609.12791#bib.bib53)for entity linking in the KG\. We set the maximum exploration depth to 4 and width \(sub\-queries per turn\) to 5\. For entity linking, we retrieve the top\-20 candidate entities\. In text exploration, we extract up to 3 relevant chunks per section\.

### 4\.2Main Results

Baseline TypeMethodMulti\-hop KG\-based QAMulti\-hop text\-based QAKGQAGenCWQQALD10\-enWebQSP2WikiMQAAdvHotpotQAMusiQueLLM\-onlyDirect36\.7032\.4247\.4572\.4547\.2020\.138\.40CoT38\.2833\.5945\.3570\.8447\.4023\.709\.60CoT\-SC40\.5033\.4046\.5571\.4049\.6024\.0310\.60Text\-based RAGVector RAG48\.6630\.7639\.0470\.4952\.6032\.1412\.40ReAct50\.7934\.1841\.4476\.1563\.2041\.8817\.00IRCoT53\.7533\.3041\.1471\.4071\.6047\.0820\.60Search\-o146\.3436\.7243\.5472\.0344\.6040\.2619\.40KG\-based RAGToG46\.9028\.4248\.6573\.2850\.4018\.839\.20PoG50\.9327\.1548\.9578\.5373\.2015\.2614\.00DoG54\.7733\.1155\.8682\.3861\.2020\.1311\.40Hybrid RAGToG\-2255\.6141\.4153\.4581\.8973\.0035\.7116\.20ProposedCoG74\.7042\.8755\.2681\.7585\.2051\.9527\.80

Table 2:Main results \(Exact Match, %\) of different methods on seven multi\-hop QA datasets\. All methods use Qwen3\-32B \(non\-thinking mode\) as the backbone LLM\. The best results are highlighted inbold\.As shown in Table[2](https://arxiv.org/html/2609.12791#S4.T2), CoG substantially outperforms baselines across most benchmarks, with advantages particularly pronounced on complex tasks\. On the challenging text\-heavy MusiQue, CoG \(27\.8%\) significantly surpasses the strongest text agent IRCoT \(20\.6%\)\. Similarly, it achieves a 34\.3% relative gain over ToG\-2 on the high\-quality KG\-based KGQAGen\. Meanwhile, CoG maintains comparable performance on simpler WebQSP \(1\-2 hops\)\. These results validate our cognitive framework’s effectiveness in unifying structured and unstructured knowledge exploration\. Additional F1 and LLM\-as\-judge results in Appendix[D](https://arxiv.org/html/2609.12791#A4)confirm that these gains persist under both lexical\-overlap and semantic evaluation\.

##### Analysis of Baselines

VectorRAG struggles with KG\-based tasks, as its flat retrieval lacks structural guidance\. Agentic text baselines \(ReAct, IRCoT, Search\-o1\) and strong KG agents \(PoG, DoG\) improve over basic RAG but exhibit single\-source limitations: text agents falter on KG\-heavy tasks, while DoG struggles on text\-heavy ones\. ToG\-2 effectively combines KG and text to outperform single\-source baselines, but its reactive exploration lacks long\-term planning and bidirectional synergy, faltering on complex tasks\. CoG consistently outperforms single\-source and hybrid baselines, proving that our Graph\-Text Synergy effectively overcomes pure graph limitations and text retrieval noise, yielding benefits beyond a generic agentic loop\.

### 4\.3Ablation Study

VariantKGQACWQQALD2WikiAdvHotMusiQAvg\.CoG \(Full\)74\.7042\.8755\.2685\.2051\.9527\.8056\.30Impact of Knowledge Sourcesw/o Text75\.9039\.0651\.6576\.2027\.2720\.2048\.38w/o KG56\.4440\.9248\.6579\.8049\.6820\.8049\.38Impact of Bidirectional Synergyw/o T\-guide74\.1442\.5852\.8576\.2039\.6122\.8051\.36w/o Synthesis73\.1241\.1150\.1583\.6043\.8324\.2052\.67Impact of Cognitive Strategyw/o Reflect72\.5742\.3852\.8585\.0048\.0525\.8054\.44w/o Plan78\.7843\.8550\.7581\.0047\.7325\.4054\.59w/o Adap\.EL70\.8144\.1453\.1586\.0047\.7323\.4054\.21

Table 3:Ablation results \(EM, %\) of CoG across three groups: \(1\)Knowledge Sources: removing either KG \(w/o KG\) or Text \(w/o Text\); \(2\)Bidirectional Synergy: disabling text\-guided KG exploration \(w/o T\-guide\), or removing summary synthesis module \(w/o Synthesis\); \(3\)Cognitive Strategy: excluding reflection\-based adjustment \(w/o Reflect\), proactive planning \(w/o Plan\), or adaptive entity linking \(w/o Adap\.EL\)\.To dissect CoG’s components, we conduct ablation studies across three dimensions \(Table[3](https://arxiv.org/html/2609.12791#S4.T3)\)\.

##### Knowledge Sources\.

Removing either source causes significant drops \(−6\.92%\-6\.92\\%forw/o KG,−7\.92%\-7\.92\\%forw/o Text\)\. The severe degradation ofw/o Texton text\-heavy datasets \(AdvHotpotQA, MusiQue\) confirms that while KG provides structural guidance, rich text semantics are indispensable for bridging knowledge gaps\.

##### Bidirectional Synergy\.

Simply accessing both sources is insufficient\. Disabling text\-to\-KG feedback \(w/o T\-guide\) drops performance by 4\.94%, indicating that entities discovered from text serve as effective new anchors for bridging disconnected KG paths\. Furthermore, removing the synthesis module \(w/o Synthesis\) degrades performance, indicating that explicitly distilling heterogeneous evidence is crucial for filtering noise and informing subsequent reasoning\.

##### Cognitive Strategy\.

Cognitive mechanisms ensure robust exploration\. Removing reflection, planning, or adaptive entity linking all degrades average performance\. These results suggest that CoG benefits not only from access to KG and text, but also from its closed\-loop control: reflection helps recover from noisy paths, planning guides goal\-oriented search, and adaptive entity linking provides reliable anchors under ambiguous mentions\.

### 4\.4In\-depth Analysis

##### Generalizability and Cost\-Effectiveness\.

Table[4](https://arxiv.org/html/2609.12791#S4.T4)demonstrates CoG’s effectiveness across diverse LLMs \(detailed in Appendix[E](https://arxiv.org/html/2609.12791#A5)\)\. Notably, CoG unlocks the reasoning potential of smaller models, yielding a massive \+113\.2% gain on Qwen3\-8B\. Remarkably, CoG\-8B \(51\.0%\) outperforms all strong 32B baselines \(e\.g\., IRCoT 44\.6%, ToG\-2 45\.9%\)\. This confirms that CoG’s superiority stems from its robust cognitive architecture rather than mere parameter scale, effectively mitigating error propagation on smaller LLMs while offering a highly cost\-effective solution\.

BackboneMethodKG Avg\.Text Avg\.Overall Avg\.Qwen3\-32BDirect41\.4825\.2433\.36CoG59\.3154\.9857\.15\(\+71\.3%\)Qwen3\-8BDirect31\.0916\.7323\.91CoG53\.3948\.5550\.97\(\+113\.2%\)gpt\-oss\-120bDirect28\.3315\.8822\.10CoG42\.8740\.2841\.58\(\+88\.1%\)DeepSeek\-V3\.2Direct47\.9128\.0637\.99CoG64\.7960\.5062\.64\(\+64\.9%\)GPT\-5\.1Direct45\.6738\.6742\.17CoG56\.0055\.3355\.67\(\+32\.0%\)

Table 4:Performance comparison \(EM, %\) of CoG versus Direct Prompting across different backbone LLMs\. Proprietary models are evaluated on a sampled subset \(100 samples per dataset\) due to cost constraints\.
##### Impact of Exploration Depth\.

Figure[3](https://arxiv.org/html/2609.12791#S4.F3)illustrates the performance trends across varying depths \(see Appendix[F](https://arxiv.org/html/2609.12791#A6)for full results\)\. On KG tasks, CoG consistently outperforms VectorRAG across all depths, confirming the superiority of structured cognitive exploration over flat retrieval\. Similarly, text tasks show steady gains as depth increases, indicating that deeper exploration effectively gathers scattered semantic evidence\. Notably, the optimal depth correlates strongly with dataset difficulty\. Simpler datasets \(WebQSP, 2WikiMQA\) achieve optimal performance at shallower depths and then stabilize, whereas challenging ones \(KGQAGen, AdvHotpotQA\) continue to benefit from deeper exploration\. It demonstrates CoG’s adaptability to varying task complexity\.

Figure 3:Impact of exploration depth on KG\-based and Text\-based tasks and representative datasets\.
##### Exploration Efficiency\.

We evaluate efficiency across four dimensions: accessed documents, token consumption, latency, and wall\-clock time per retrieval round \(detailed breakdown in Appendix[G](https://arxiv.org/html/2609.12791#A7)\)\. Despite multiple LLM calls per turn, CoG’s goal\-oriented planning achieves remarkable precision, accessing12\.4×12\.4\\timesfewer documents than ToG\-2’s exhaustive beam search \(Table[5](https://arxiv.org/html/2609.12791#S4.T5)\)\. Regarding absolute cost, CoG exhibits complexity adaptability: on simpler datasets \(e\.g\., WebQSP\), it maintains low token usage \(∼\\sim15k\) comparable to text agents like IRCoT \(∼\\sim22k\) while achieving superior accuracy\. On complex tasks \(e\.g\., MusiQue\), costs increase to support deep reasoning, trading computation for capability where efficient methods fail\. Crucially, this overhead can be mitigated by using smaller models, as CoG\-8B already outperforms 32B baselines \(Appendix[E](https://arxiv.org/html/2609.12791#A5)\), improving the accuracy\-cost trade\-off for deployment\.

MethodKGQACWQQALDWebQ2WikiHotpotMusiQAvg\.ToG\-237\.140\.431\.222\.917\.736\.142\.232\.5CoG3\.13\.12\.31\.52\.42\.53\.52\.6Gain×\\times11\.9×\\times13\.2×\\times13\.3×\\times15\.5×\\times7\.3×\\times14\.8×\\times12\.1×\\times12\.4

Table 5:Comparison of exploration efficiency \(Average number of unique documents accessed per question\)\.
##### Hyperparameter Robustness\.

We study the sensitivity of adaptive entity linking by varying the retrieved entity candidates fromk=6k=6to3030\(Appendix[H](https://arxiv.org/html/2609.12791#A8)\)\. CoG remains stable across settings, with average EM varying only slightly from 59\.1% to 60\.3%\. Increasingkkdoes not degrade performance, suggesting that CoG’s context\-aware disambiguation can filter noisy candidates while benefiting from broader entity recall\.

##### Manual Evaluation\.

We manually analyze sampled reasoning paths in Appendix[I](https://arxiv.org/html/2609.12791#A9)to evaluate reasoning faithfulness and diagnose error causes\. For EM\-correct cases, CoG yields the highest proportion ofTrue Positives\(89\.1%\) with faithful reasoning chains\. In contrast, CoT\-SC and ToG\-2 suffer more severe false positives \(Weak FP \+ FP: 29\.1% and 12\.7% vs\. CoG’s 3\.6%\), often reaching correct answers via hallucinated or flawed intermediate steps\. For EM\-incorrect cases, 71\.1% of CoG’s errors are attributable to external factors such as metric false negatives, dataset flaws, or temporal mismatch, while 28\.9% reflect internal exploration or reasoning failures\. These findings support both the reliability of CoG’s EM gains and the need for stronger exploration focus and disambiguation\.

##### Qualitative Analysis\.

We provide a detailed case study in Appendix[J](https://arxiv.org/html/2609.12791#A10), demonstrating how CoG’s cognitive cycle and bidirectional synergy enable it to recover from dead ends and discover critical text evidence to solve complex multi\-hop queries\.

## 5Conclusion

In this paper, we introduced CoG, a cognitive\-inspired framework for autonomous knowledge exploration in global, hybrid knowledge bases\. Under the continuous “plan\-explore\-reflect” human cognitive cycle, CoG shifts the paradigm from passive, reactive retrieval to proactive knowledge discovery, enabling adaptive strategy adjustment and robust recovery from exploration failures\. Crucially, it establishes a deep bidirectional synergy between structured KGs and unstructured text, leveraging their complementary strengths to bridge knowledge gaps\. Extensive experiments demonstrate that CoG significantly outperforms state\-of\-the\-art baselines on multiple multi\-hop QA tasks while achieving superior exploration efficiency\.

## Limitations

While CoG demonstrates superior performance and exploration efficiency in global knowledge exploration, several limitations remain\.

##### Latency and Cost\.

The iterative cognitive loop inevitably incurs higher inference latency and token cost than passive retrieval methods\. Although CoG reduces redundant document access through goal\-oriented exploration and can improve the cost\-accuracy trade\-off when paired with smaller backbones, its multi\-call workflow may still limit real\-time deployment\.

##### Dependency on Backbone LLM\.

The framework’s effectiveness still depends on the backbone LLM’s instruction following and long\-context reasoning abilities\. Although CoG substantially improves smaller models, weaker LLMs may still struggle with complex planning, evidence synthesis, or reflection over noisy intermediate results\.

## Acknowledgments

This work is supported by the Zhongguancun Academy \(Grant No\. 02012501\), in part by the National Natural Science Foundation of China \(Grant Nos\. 62473271, 62506357\), and the Fundamental Research Funds for the Beijing University of Posts and Telecommunications \(Grant No\. 2025AI4S03\)\.

## References

- Chang et al\. \(2026\)Ge Chang, Jinbo Su, Jiacheng Liu, Pengfei Yang, Yuhao Shang, Huiwen Zheng, Hongli Ma, Yan Liang, Yuanchun Li, and Yunxin Liu\. 2026\.[Enhancing agentic textual graph retrieval with synthetic stepwise supervision](https://doi.org/10.18653/v1/2026.acl-long.1169)\.In*ACL*, pages 25510–25525, San Diego, California, United States\. Association for Computational Linguistics\.
- Chen et al\. \(2024a\)Jianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, and Zheng Liu\. 2024a\.[M3\-embedding: Multi\-linguality, multi\-functionality, multi\-granularity text embeddings through self\-knowledge distillation](https://doi.org/10.18653/v1/2024.findings-acl.137)\.In*Findings of ACL*, pages 2318–2335, Bangkok, Thailand\. Association for Computational Linguistics\.
- Chen et al\. \(2024b\)Liyi Chen, Panrong Tong, Zhongming Jin, Ying Sun, Jieping Ye, and Hui Xiong\. 2024b\.[Plan\-on\-graph: Self\-correcting adaptive planning of large language model on knowledge graphs](https://doi.org/10.52202/079017-1189)\.In*NeurIPS*, volume 37, pages 37665–37691\. Curran Associates, Inc\.
- Chen et al\. \(2025\)Weijie Chen, Ting Bai, Jinbo Su, Jian Luan, Wei Liu, and Chuan Shi\. 2025\.[Kg\-retriever: Efficient knowledge indexing for retrieval\-augmented large language models](https://doi.org/10.1109/ICKG66886.2025.00011)\.In*2025 IEEE International Conference on Knowledge Graph \(ICKG\)*, pages 27–34\.
- Cui et al\. \(2025\)Yuanning Cui, Zequn Sun, Wei Hu, and Zhangjie Fu\. 2025\.[Kgfr: A foundation retriever for generalized knowledge graph question answering](https://arxiv.org/abs/2511.04093)\.*Preprint*, arXiv:2511\.04093\.
- Dong et al\. \(2026\)Junnan Dong, Siyu An, Yifei Yu, QIANWEN ZHANG, Linhao Luo, Xiao Huang, di yin, Yunsheng Wu, and Xing Sun\. 2026\.[Youtu\-graphrag: Vertically unified agents for graph retrieval\-augmented complex reasoning](https://proceedings.iclr.cc/paper_files/paper/2026/file/e8618f2038b0209705e4d5e3cd496e1d-Paper-Conference.pdf)\.In*ICLR*, volume 2026, pages 143735–143755\.
- Edge et al\. \(2024\)Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, and Jonathan Larson\. 2024\.[From local to global: A graph rag approach to query\-focused summarization](https://arxiv.org/abs/2404.16130)\.*Preprint*, arXiv:2404\.16130\.
- Guo et al\. \(2024\)Zirui Guo, Lianghao Xia, Yanhua Yu, Tu Ao, and Chao Huang\. 2024\.[Lightrag: Simple and fast retrieval\-augmented generation](https://arxiv.org/abs/2410.05779)\.*Preprint*, arXiv:2410\.05779\.
- Gutiérrez et al\. \(2025\)Bernal Jiménez Gutiérrez, Yiheng Shu, Weijian Qi, Sizhe Zhou, and Yu Su\. 2025\.[From RAG to memory: Non\-parametric continual learning for large language models](https://proceedings.mlr.press/v267/gutierrez25a.html)\.In*ICML*, volume 267 of*Proceedings of Machine Learning Research*, pages 21497–21515\. PMLR\.
- Gutiérrez et al\. \(2024\)Bernal Jiménez Gutiérrez, Yiheng Shu, Yu Gu, Michihiro Yasunaga, and Yu Su\. 2024\.[HippoRAG: Neurobiologically inspired long\-term memory for large language models](https://doi.org/10.52202/079017-1902)\.In*NeurIPS*, volume 37, pages 59532–59569\. Curran Associates, Inc\.
- Ho et al\. \(2020\)Xanh Ho, Anh\-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa\. 2020\.[Constructing a multi\-hop QA dataset for comprehensive evaluation of reasoning steps](https://doi.org/10.18653/v1/2020.coling-main.580)\.In*Proceedings of the 28th International Conference on Computational Linguistics*, pages 6609–6625, Barcelona, Spain \(Online\)\. International Committee on Computational Linguistics\.
- Huang et al\. \(2025a\)Haoyu Huang, Yongfeng Huang, Yang Junjie, Zhenyu Pan, Yongqiang Chen, Kaili Ma, Hongzhi Chen, and James Cheng\. 2025a\.[Retrieval\-augmented generation with hierarchical knowledge](https://doi.org/10.18653/v1/2025.findings-emnlp.321)\.In*Findings of the Association for Computational Linguistics: EMNLP 2025*, pages 6044–6060, Suzhou, China\. Association for Computational Linguistics\.
- Huang et al\. \(2025b\)Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and Ting Liu\. 2025b\.[A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions](https://doi.org/10.1145/3703155)\.*ACM Trans\. Inf\. Syst\.*, 43\(2\)\.
- Jiang et al\. \(2023\)Jinhao Jiang, Kun Zhou, Zican Dong, Keming Ye, Xin Zhao, and Ji\-Rong Wen\. 2023\.[StructGPT: A general framework for large language model to reason over structured data](https://doi.org/10.18653/v1/2023.emnlp-main.574)\.In*EMNLP*, pages 9237–9251, Singapore\. Association for Computational Linguistics\.
- Jiang et al\. \(2025\)Jinhao Jiang, Kun Zhou, Xin Zhao, Yang Song, Chen Zhu, Hengshu Zhu, and Ji\-Rong Wen\. 2025\.[KG\-agent: An efficient autonomous agent framework for complex reasoning over knowledge graph](https://doi.org/10.18653/v1/2025.acl-long.468)\.In*Proceedings of the 63rd annual meeting of the association for computational linguistics \(volume 1: Long papers\)*, pages 9505–9523\. Association for Computational Linguistics\.
- Lee et al\. \(2025\)Meng\-Chieh Lee, Qi Zhu, Costas Mavromatis, Zhen Han, Soji Adeshina, Vassilis N\. Ioannidis, Huzefa Rangwala, and Christos Faloutsos\. 2025\.[HybGRAG: Hybrid retrieval\-augmented generation on textual and relational knowledge bases](https://doi.org/10.18653/v1/2025.acl-long.43)\.In*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 879–893\. Association for Computational Linguistics\.
- Lei et al\. \(2025\)Yongjia Lei, Haoyu Han, Ryan A\. Rossi, Franck Dernoncourt, Nedim Lipka, Mahantesh M Halappanavar, Jiliang Tang, and Yu Wang\. 2025\.[Mixture of structural\-and\-textual retrieval over text\-rich graph knowledge bases](https://doi.org/10.18653/v1/2025.findings-acl.941)\.In*Findings of the Association for Computational Linguistics: ACL 2025*, pages 18306–18321, Vienna, Austria\. Association for Computational Linguistics\.
- Lewis et al\. \(2020\)Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen\-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela\. 2020\.[Retrieval\-augmented generation for knowledge\-intensive nlp tasks](https://proceedings.neurips.cc/paper_files/paper/2020/file/6b493230205f780e1bc26945df7481e5-Paper.pdf)\.In*NeurIPS*, volume 33, pages 9459–9474\. Curran Associates, Inc\.
- Li et al\. \(2024a\)Shilong Li, Yancheng He, Hangyu Guo, Xingyuan Bu, Ge Bai, Jie Liu, Jiaheng Liu, Xingwei Qu, Yangguang Li, Wanli Ouyang, Wenbo Su, and Bo Zheng\. 2024a\.[GraphReader: Building graph\-based agent to enhance long\-context abilities of large language models](https://doi.org/10.18653/v1/2024.findings-emnlp.746)\.In*Findings of the Association for Computational Linguistics: EMNLP 2024*, pages 12758–12786\. Association for Computational Linguistics\.
- Li et al\. \(2025a\)Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, and Zhicheng Dou\. 2025a\.[Search\-o1: Agentic search\-enhanced large reasoning models](https://doi.org/10.18653/v1/2025.emnlp-main.276)\.In*EMNLP*, pages 5420–5438, Suzhou, China\. Association for Computational Linguistics\.
- Li et al\. \(2024b\)Xingxuan Li, Ruochen Zhao, Yew Ken Chia, Bosheng Ding, Shafiq Joty, Soujanya Poria, and Lidong Bing\. 2024b\.[Chain\-of\-knowledge: Grounding large language models via dynamic knowledge adapting over heterogeneous sources](https://proceedings.iclr.cc/paper_files/paper/2024/file/285ba60a67a66d2efeeb7cb25c5067fe-Paper-Conference.pdf)\.In*ICLR*, volume 2024, pages 9565–9587\.
- Li et al\. \(2025b\)Yangning Li, Weizhi Zhang, Yuyao Yang, Wei\-Chieh Huang, Yaozu Wu, Junyu Luo, Yuanchen Bei, Henry Peng Zou, Xiao Luo, Yusheng Zhao, Chunkit Chan, Yankai Chen, Zhongfen Deng, Yinghui Li, Hai\-Tao Zheng, Dongyuan Li, Renhe Jiang, Ming Zhang, Yangqiu Song, and Philip S\. Yu\. 2025b\.[Towards agentic rag with deep reasoning: A survey of rag\-reasoning systems in llms](https://arxiv.org/abs/2507.09477)\.*Preprint*, arXiv:2507\.09477\.
- Lin et al\. \(2026\)Junhong Lin, Shicheng Liu, Jinyeop Song, Song Wang, Julian Shun, and Yada Zhu\. 2026\.[Efficient and transferable agentic knowledge graph rag via reinforcement learning](https://arxiv.org/abs/2509.26383)\.*Preprint*, arXiv:2509\.26383\.
- Luo et al\. \(2026\)Haoran Luo, Haihong E, Guanting Chen, Qika Lin, Yikai Guo, Fangzhi Xu, Zemin Kuang, Meina Song, Xiaobao Wu, Yifan Zhu, and Luu Anh Tuan\. 2026\.[Graph\-r1: Towards agentic graphrag framework via end\-to\-end reinforcement learning](https://arxiv.org/abs/2507.21892)\.*Preprint*, arXiv:2507\.21892\.
- Luo et al\. \(2025a\)Linhao Luo, Zicheng Zhao, Reza Haffari, Dinh Phung, Chen Gong, and Shirui Pan\. 2025a\.[Gfm\-rag: Graph foundation model for retrieval augmented generation](https://doi.org/10.52202/085713-1222)\.In*NeurIPS*, volume 38, Main Conference, pages 36371–36405\. Curran Associates, Inc\.
- Luo et al\. \(2025b\)Qi Luo, Xiaonan Li, Tingshuo Fan, Xinchi Chen, and Xipeng Qiu\. 2025b\.[Towards global retrieval augmented generation: A benchmark for corpus\-level reasoning](https://arxiv.org/abs/2510.26205)\.*Preprint*, arXiv:2510\.26205\.
- Ma et al\. \(2025a\)Jie Ma, Zhitao Gao, Qi Chai, Wangchun Sun, Pinghui Wang, Hongbin Pei, Jing Tao, Lingyun Song, Jun Liu, Chen Zhang, and Lizhen Cui\. 2025a\.[Debate on graph: A flexible and reliable reasoning framework for large language models](https://doi.org/10.1609/aaai.v39i23.34658)\.In*AAAI*, volume 39, pages 24768–24776\.
- Ma et al\. \(2025b\)Shengjie Ma, Chengjin Xu, Xuhui Jiang, Muzhi Li, Huaren Qu, Cehao Yang, Jiaxin Mao, and Jian Guo\. 2025b\.[Think\-on\-graph 2\.0: Deep and faithful large language model reasoning with knowledge\-guided retrieval augmented generation](https://proceedings.iclr.cc/paper_files/paper/2025/file/830b1abc6d2da85f23d41169fa44d185-Paper-Conference.pdf)\.In*ICLR*, volume 2025, pages 52782–52806\.
- Sarmah et al\. \(2024\)Bhaskarjit Sarmah, Dhagash Mehta, Benika Hall, Rohan Rao, Sunil Patel, and Stefano Pasquali\. 2024\.[HybridRAG: Integrating knowledge graphs and vector retrieval augmented generation for efficient information extraction](https://doi.org/10.1145/3677052.3698671)\.In*Proceedings of the 5th ACM International Conference on AI in Finance*, ICAIF ’24, pages 608–616\. Association for Computing Machinery\.
- Song et al\. \(2025\)Zirui Song, Bin Yan, Yuhan Liu, Miao Fang, Mingzhe Li, Rui Yan, and Xiuying Chen\. 2025\.[Injecting domain\-specific knowledge into large language models: A comprehensive survey](https://doi.org/10.18653/v1/2025.findings-emnlp.1379)\.In*Findings of the Association for Computational Linguistics: EMNLP 2025*, pages 25297–25311, Suzhou, China\. Association for Computational Linguistics\.
- Sun et al\. \(2024\)Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Saizhuo Wang, Chen Lin, Yeyun Gong, Lionel Ni, Heung\-Yeung Shum, and Jian Guo\. 2024\.[Think\-on\-graph: Deep and responsible reasoning of large language model on knowledge graph](https://proceedings.iclr.cc/paper_files/paper/2024/file/10a6bdcabbd5a3d36b760daa295f63c1-Paper-Conference.pdf)\.In*ICLR*, volume 2024, pages 3868–3898\.
- Sun et al\. \(2025\)Yushi Sun, Kai Sun, Yifan Ethan Xu, Xiao Yang, Xin Luna Dong, Nan Tang, and Lei Chen\. 2025\.[KERAG: Knowledge\-enhanced retrieval\-augmented generation for advanced question answering](https://doi.org/10.18653/v1/2025.findings-emnlp.329)\.In*Findings of the Association for Computational Linguistics: EMNLP 2025*, pages 6194–6216\. Association for Computational Linguistics\.
- Talmor and Berant \(2018\)Alon Talmor and Jonathan Berant\. 2018\.[The web as a knowledge\-base for answering complex questions](https://doi.org/10.18653/v1/N18-1059)\.In*Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 \(Long Papers\)*, pages 641–651, New Orleans, Louisiana\. Association for Computational Linguistics\.
- Tan et al\. \(2025\)Xingyu Tan, Xiaoyang Wang, Qing Liu, Xiwei Xu, Xin Yuan, Liming Zhu, and Wenjie Zhang\. 2025\.[HydraRAG: Structured cross\-source enhanced large language model reasoning](https://doi.org/10.18653/v1/2025.emnlp-main.730)\.In*Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing*, pages 14431–14459, Suzhou, China\. Association for Computational Linguistics\.
- Trivedi et al\. \(2022\)Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal\. 2022\.[MuSiQue: Multihop questions via single\-hop question composition](https://doi.org/10.1162/tacl_a_00475)\.*Transactions of the Association for Computational Linguistics*, 10:539–554\.
- Trivedi et al\. \(2023\)Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal\. 2023\.[Interleaving retrieval with chain\-of\-thought reasoning for knowledge\-intensive multi\-step questions](https://doi.org/10.18653/v1/2023.acl-long.557)\.In*Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 10014–10037\. Association for Computational Linguistics\.
- Usbeck et al\. \(2024\)Ricardo Usbeck, Xi Yan, Aleksandr Perevalov, Longquan Jiang, Julius Schulz, Angelie Kraft, Cedric Möller, Junbo Huang, Jan Reineke, Axel\-Cyrille Ngonga Ngomo, et al\. 2024\.[Qald\-10–the 10th challenge on question answering over linked data: Shifting from dbpedia to wikidata as a kg for kgqa](https://doi.org/10.3233/SW-233471)\.*Semantic Web*, 15\(6\):2193–2207\.
- Wang et al\. \(2025\)Song Wang, Junhong Lin, Xiaojie Guo, Julian Shun, Jundong Li, and Yada Zhu\. 2025\.[Reasoning of large language models over knowledge graphs with super\-relations](https://proceedings.iclr.cc/paper_files/paper/2025/file/0c6799a1a5db47be8864fed46ba77697-Paper-Conference.pdf)\.In*ICLR*, volume 2025, pages 4208–4226\.
- Wang et al\. \(2026\)Xinming Wang, Jian Xu, Sheng Lian, Yi Chen, Haiyang Guo, Fei Zhu, Yuanqi Shao, Minsi Ren, Hongzhu Yi, Aslan H\. Feng, Hongming Yang, Tailin Wu, Han Hu, Shiming Xiang, Xu\-Yao Zhang, and Cheng\-Lin Liu\. 2026\.[The hitchhiker’s guide to autonomous research: A survey of scientific agents](https://doi.org/10.1109/TPAMI.2026.3721500)\.*IEEE Transactions on Pattern Analysis and Machine Intelligence*, pages 1–20\.
- Wang et al\. \(2023\)Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V Le, Ed H\. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou\. 2023\.[Self\-consistency improves chain of thought reasoning in language models](https://openreview.net/forum?id=1PL1NIMMrw)\.In*ICLR*\.
- Wang et al\. \(2024\)Yu Wang, Nedim Lipka, Ryan A\. Rossi, Alexa Siu, Ruiyi Zhang, and Tyler Derr\. 2024\.[Knowledge graph prompting for multi\-document question answering](https://doi.org/10.1609/aaai.v38i17.29889)\.In*AAAI*, volume 38, pages 19206–19214\.
- Wei et al\. \(2022\)Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed Chi, Quoc V Le, and Denny Zhou\. 2022\.[Chain\-of\-thought prompting elicits reasoning in large language models](https://doi.org/10.52202/068431-1800)\.In*NeurIPS*, volume 35, pages 24824–24837\. Curran Associates, Inc\.
- Wu et al\. \(2026\)Xiaojun Wu, Cehao Yang, Xueyuan Lin, Chengjin Xu, Xuhui Jiang, Yuanliang Sun, Hui Xiong, Jia Li, and Jian Guo\. 2026\.[Think\-on\-graph 3\.0: Efficient and adaptive llm reasoning on heterogeneous graphs via multi\-agent dual\-evolving context retrieval](https://arxiv.org/abs/2509.21710)\.*Preprint*, arXiv:2509\.21710\.
- Xu et al\. \(2026\)Jiasheng Xu, Mingda Li, Yongqiang Tang, Peijie Wang, and Wensheng Zhang\. 2026\.[Towards open\-world retrieval\-augmented generation on knowledge graph: A multi\-agent collaboration framework](https://doi.org/10.1145/3774904.3792389)\.In*Proceedings of the ACM Web Conference 2026*, WWW ’26, page 2171–2182, New York, NY, USA\. Association for Computing Machinery\.
- Yang et al\. \(2025\)Cehao Yang, Xiaojun Wu, Xueyuan Lin, Chengjin Xu, Xuhui Jiang, Yuanliang Sun, Jia Li, Hui Xiong, and Jian Guo\. 2025\.[Graphsearch: An agentic deep searching workflow for graph retrieval\-augmented generation](https://arxiv.org/abs/2509.22009)\.*Preprint*, arXiv:2509\.22009\.
- Yang et al\. \(2018\)Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D\. Manning\. 2018\.[HotpotQA: A dataset for diverse, explainable multi\-hop question answering](https://doi.org/10.18653/v1/D18-1259)\.In*Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing*, pages 2369–2380\. Association for Computational Linguistics\.
- Yao et al\. \(2023\)Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao\. 2023\.[React: Synergizing reasoning and acting in language models](https://openreview.net/forum?id=WE_vluYUL-X)\.In*ICLR*\.
- Ye and Durrett \(2022\)Xi Ye and Greg Durrett\. 2022\.[The unreliability of explanations in few\-shot prompting for textual reasoning](https://doi.org/10.52202/068431-2202)\.In*NeurIPS*, volume 35, pages 30378–30392\.
- Yih et al\. \(2016\)Wen\-tau Yih, Matthew Richardson, Chris Meek, Ming\-Wei Chang, and Jina Suh\. 2016\.[The value of semantic parse labeling for knowledge base question answering](https://doi.org/10.18653/v1/P16-2033)\.In*ACL*, pages 201–206, Berlin, Germany\. Association for Computational Linguistics\.
- Yu et al\. \(2026\)Chuanyue Yu, Kuo Zhao, Yuhan Li, Heng Chang, Mingjian Feng, Xiangzhe Jiang, Yufei Sun, Jia Li, Yuzhi Zhang, Qingyun Sun, Jianxin Li, and Ziwei Zhang\. 2026\.[Graphrag\-r1: Graph retrieval\-augmented generation with process\-constrained reinforcement learning](https://doi.org/10.1145/3774904.3792589)\.In*Proceedings of the ACM Web Conference 2026, WWW 2026, Dubai, United Arab Emirates, originally scheduled for April 13\-17, 2026, rescheduled for June 29 \- July 3, 2026*, pages 1398–1409\. ACM\.
- Zhang et al\. \(2025a\)Liangliang Zhang, Zhuorui Jiang, Hongliang Chi, Haoyang Chen, Mohammed ElKoumy, Fali Wang, Qiong Wu, Zhengyi Zhou, Shirui Pan, Suhang Wang, and Yao Ma\. 2025a\.[Diagnosing and addressing pitfalls in kg\-rag datasets: Toward more reliable benchmarking](https://doi.org/10.52202/085713-2274)\.In*NeurIPS*, volume 38, Main Conference\. Curran Associates, Inc\.
- Zhang et al\. \(2025b\)Qinggang Zhang, Shengyuan Chen, Yuanchen Bei, Zheng Yuan, Huachi Zhou, Zijin Hong, Hao Chen, Yilin Xiao, Chuang Zhou, Junnan Dong, Yi Chang, and Xiao Huang\. 2025b\.[A survey of graph retrieval\-augmented generation for customized large language models](https://arxiv.org/abs/2501.13958)\.*Preprint*, arXiv:2501\.13958\.
- Zhang et al\. \(2025c\)Yanzhao Zhang, Mingxin Li, Dingkun Long, Xin Zhang, Huan Lin, Baosong Yang, Pengjun Xie, An Yang, Dayiheng Liu, Junyang Lin, Fei Huang, and Jingren Zhou\. 2025c\.[Qwen3 embedding: Advancing text embedding and reranking through foundation models](https://arxiv.org/abs/2506.05176)\.*Preprint*, arXiv:2506\.05176\.
- Zhu et al\. \(2025\)Xiangrong Zhu, Yuexiang Xie, Yi Liu, Yaliang Li, and Wei Hu\. 2025\.[Knowledge graph\-guided retrieval augmented generation](https://doi.org/10.18653/v1/2025.naacl-long.449)\.In*NAACL*, pages 8912–8924, Albuquerque, New Mexico\. Association for Computational Linguistics\.

## Appendix ACoG Algorithm

We provide the pseudo\-code of the CoG framework in Algorithm[1](https://arxiv.org/html/2609.12791#alg1)\. It outlines the iterative workflow, illustrating how the Planning, Exploration, Synthesis, and Reflection modules coordinate to achieve autonomous knowledge exploration in large\-scale knowledge bases\.

Algorithm 1The CoG Algorithm0:Question

qq, KG

𝒢\\mathcal\{G\}, Text Corpus

𝒟\\mathcal\{D\}, Max Turns

MM
0:Answer

aa
Initialize:

𝒩←∅\\mathcal\{N\}\\leftarrow\\emptyset,

𝒫←∅\\mathcal\{P\}\\leftarrow\\emptyset,

ℋ←∅\\mathcal\{H\}\\leftarrow\\emptyset
//Phase 1: Initial Planning\(§[3\.2\.1](https://arxiv.org/html/2609.12791#S3.SS2.SSS1)\)

P0=\(A0,Q0,E0\)←InitPlan​\(q\)P\_\{0\}=\(A\_\{0\},Q\_\{0\},E\_\{0\}\)\\leftarrow\\textsc\{InitPlan\}\(q\)

for

t=0t=0to

M−1M\-1do

//Phase 2: Exploration Dual\-Source\(§[3\.2\.2](https://arxiv.org/html/2609.12791#S3.SS2.SSS2)\)

Kt←∅K\_\{t\}\\leftarrow\\emptyset

foreach

\(qi\(t\),ei\(t\)\)∈\(Qt,Et\)\(q\_\{i\}^\{\(t\)\},e\_\{i\}^\{\(t\)\}\)\\in\(Q\_\{t\},E\_\{t\}\)do

Ci\(t\)←\(q,At,qi\(t\),ei\(t\)\)C\_\{i\}^\{\(t\)\}\\leftarrow\(q,A\_\{t\},q\_\{i\}^\{\(t\)\},e\_\{i\}^\{\(t\)\}\)// Query context

FiK​G←ExploreKG​\(Ci\(t\),𝒢\)F\_\{i\}^\{KG\}\\leftarrow\\textsc\{ExploreKG\}\(C\_\{i\}^\{\(t\)\},\\mathcal\{G\}\)

// Entity Link→\\rightarrowRelation Discovery→\\rightarrowFact Prune

Fit​e​x​t←ExploreText​\(Ci\(t\),𝒟\)F\_\{i\}^\{text\}\\leftarrow\\textsc\{ExploreText\}\(C\_\{i\}^\{\(t\)\},\\mathcal\{D\}\)

// Page Selection→\\rightarrowSkimming→\\rightarrowDetailed Reading

Kt←Kt∪\{FiK​G∪Fit​e​x​t\}K\_\{t\}\\leftarrow K\_\{t\}\\cup\\\{F\_\{i\}^\{KG\}\\cup F\_\{i\}^\{text\}\\\}// Aggregate dual\-source evidence

endfor

//Phase 3: Synthesis\(§[3\.2\.3](https://arxiv.org/html/2609.12791#S3.SS2.SSS3)\)

Jt,Mt←Synthesize​\(q,Pt,Kt,𝒩\)J\_\{t\},M\_\{t\}\\leftarrow\\textsc\{Synthesize\}\(q,P\_\{t\},K\_\{t\},\\mathcal\{N\}\)

//Phase 4: Reflection & Re\-Planning\(§[3\.2\.3](https://arxiv.org/html/2609.12791#S3.SS2.SSS3)\)

if

Jt=SUFFICIENTJ\_\{t\}=\\texttt\{SUFFICIENT\}then

break// Proceed to Answer Generation

elseif

Jt=INSUFFICIENT\_USEFULJ\_\{t\}=\\texttt\{INSUFFICIENT\\\_USEFUL\}then

// Pathway 1: Continue Exploration

Pt\+1,𝒩,𝒫←ContinuePlan​\(q,Pt,Mt,𝒩,𝒫\)P\_\{t\+1\},\\mathcal\{N\},\\mathcal\{P\}\\leftarrow\\textsc\{ContinuePlan\}\(q,P\_\{t\},M\_\{t\},\\mathcal\{N\},\\mathcal\{P\}\)

else

// Pathway 2: Strategy Adjustment

Pt\+1,𝒫←AdjustPlan​\(q,Pt,Mt,ℋ,𝒩,𝒫\)P\_\{t\+1\},\\mathcal\{P\}\\leftarrow\\textsc\{AdjustPlan\}\(q,P\_\{t\},M\_\{t\},\\mathcal\{H\},\\mathcal\{N\},\\mathcal\{P\}\)

endif

ℋ←ℋ∪\{\(Pt,Mt\)\}\\mathcal\{H\}\\leftarrow\\mathcal\{H\}\\cup\\\{\(P\_\{t\},M\_\{t\}\)\\\}// Update Interaction History

endfor

//Answer Generation\(§[3\.2\.4](https://arxiv.org/html/2609.12791#S3.SS2.SSS4)\)

a←GenerateAnswer​\(q,𝒩,Pt,Mt\)a\\leftarrow\\textsc\{GenerateAnswer\}\(q,\\mathcal\{N\},P\_\{t\},M\_\{t\}\)

return

aa

## Appendix BEvaluation Dataset

In this section, we provide detailed descriptions of the seven multi\-hop question answering datasets used in our experiments, covering both KG\-based and text\-based multi\-hop reasoning tasks\.

##### KG\-based QA Datasets\.

These benchmarks primarily require reasoning over structured facts in the knowledge graph and usually expect entity\-centric answers grounded in KG nodes or literal attributes\.

WebQSP[Yih et al\. \(2016\)](https://arxiv.org/html/2609.12791#bib.bib49)is a widely used knowledge base QA benchmark derived from WebQuestions, containing questions paired with SPARQL queries over Freebase \(mapped to Wikidata in our setting\)\. It primarily focuses on questions that require 1\-2 hop reasoning over structured KG facts to retrieve target entities\.

CWQ[Talmor and Berant \(2018\)](https://arxiv.org/html/2609.12791#bib.bib33)extends the WebQSP by generating questions with higher complexity\. It necessitates multi\-hop reasoning \(up to 4 hops\) and challenges models to handle intricate logical constraints, such as composition, conjunctions, and superlatives over the graph structure\.

QALD10\-en[Usbeck et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib37)is the English subset of the 10th Question Answering over Linked Data challenge, specifically adapted for Wikidata\. It is characterized by highly complex natural language questions that map to intricate SPARQL queries\. The dataset specifically tests a system’s ability to handle advanced structural operations, such as aggregations, filters, and multi\-hop relationships\.

KGQAGen[Zhang et al\. \(2025a\)](https://arxiv.org/html/2609.12791#bib.bib51)is a highly reliable, Wikidata\-grounded benchmark generated via an LLM\-in\-the\-loop framework with symbolic verification, featuring a wide range of topics and structural complexities\. It systematically addresses the inaccurate annotations and ambiguity in existing evaluation datasets, making it a superior standard for evaluating multi\-hop reasoning capabilities in KG\-based RAG systems\.

##### Text\-based QA Datasets\.

These benchmarks demand semantic understanding and multi\-document synthesis, covering span extraction and more free\-form answer types such as dates, numbers, boolean answers, and short descriptive phrases\.

2WikiMQA[Ho et al\. \(2020\)](https://arxiv.org/html/2609.12791#bib.bib11)is a large\-scale dataset synthesized from Wikidata and Wikipedia, specifically designed to test multi\-hop reasoning across multiple documents\. It focuses on questions that require comparison, aggregation, and bridging reasoning types\. The questions typically require reasoning chains of 2 to 4 hops, challenging models to perform cross\-document integration and logical inference over unstructured text\.

MusiQue[Trivedi et al\. \(2022\)](https://arxiv.org/html/2609.12791#bib.bib35)is a highly challenging multi\-hop QA dataset constructed by compositing single\-hop questions in a bottom\-up manner\. It is explicitly designed to minimize reasoning shortcuts and enforce connected reasoning, ensuring that answering the final question strictly requires resolving intermediate sub\-questions\. The dataset features 2\-4 hop questions that are significantly harder to solve via disconnected reasoning compared to HotpotQA or 2WikiMQA\.

AdvHotpotQA[Ye and Durrett \(2022\)](https://arxiv.org/html/2609.12791#bib.bib48)is an adversarial version of the HotpotQA[Yang et al\. \(2018\)](https://arxiv.org/html/2609.12791#bib.bib46)dataset\. It introduces distractor paragraphs that share high lexical overlap with the question but do not contain the answer, rigorously testing the system’s robustness against retrieval noise and its ability to identify supporting evidence accurately\.

Table[6](https://arxiv.org/html/2609.12791#A2.T6)summarizes the statistics of the evaluation datasets\. For WebQSP, AdvHotpotQA, and QALD10\-en, we use the same test splits as in ToG\-2[Ma et al\. \(2025b\)](https://arxiv.org/html/2609.12791#bib.bib28)for fair comparison\. For CWQ, we adopt the first 1,024 questions from the test set used in ToG[Sun et al\. \(2024\)](https://arxiv.org/html/2609.12791#bib.bib31)\. For 2WikiMQA and MusiQue, we employ the evaluation sets provided by IRCoT[Trivedi et al\. \(2023\)](https://arxiv.org/html/2609.12791#bib.bib36)\. For KGQAGen, we use the full test set from the KGQAGen\-10k benchmark\.

CategoryDataset\# QuestionsKG\-basedQAWebQSP1,430CWQ1,024QALD10\-en333KGQAGen\-10k1,079Text\-basedQA2WikiMQA500MusiQue500AdvHotpotQA308Table 6:Statistics of the evaluation datasets\.

## Appendix CKnowledge Bases

CoG operates over a global knowledge environment that combines structured symbolic facts from Wikidata with entity\-centric textual evidence from Wikipedia\. This design allows the model to alternate between precise graph\-based reasoning and flexible textual exploration, which is important for open\-domain multi\-hop questions where either source alone may be incomplete\.

##### Structured Knowledge Graph \(Wikidata\)\.

We use the full Wikidata dump111[https://dumps\.wikimedia\.org/wikidatawiki/entities/](https://dumps.wikimedia.org/wikidatawiki/entities/)\(May 2024\) as the structured knowledge graph\. After preprocessing, the resulting graph contains 89\.3 million entities and 1\.38 billion edges\. We distinguish two types of edges: relational edges between entities \(e\.g\.,\(Steve Jobs, founded, Apple\)\), and attribute edges that connect entities to literal values such as dates, quantities, or strings \(e\.g\.,\(Steve Jobs, date of birth, 1955\-02\-24\)\)\. In total, the processed graph contains 823\.7 million relational triples and 562\.0 million attribute triples\.

This large\-scale setting is substantially different from task\-specific or locally constructed KGs\. It requires entity linking and retrieval to operate over a global entity space rather than a small candidate graph\.

##### Knowledge Graph Preprocessing\.

We process Wikidata into a retrieval\-oriented representation to efficiently support CoG’s core operations\.

Forentity grounding, we extract English labels, aliases, and descriptions\. These are encoded viaQwen3\-Embedding\-4Binto a FAISS index, enabling dense candidate recall across nearly 90 million entities with only∼\\sim10GB of storage\. Since many Wikidata entities share similar or identical names, each candidate is further supplemented with a compact entity profile, including textual metadata, popularity signals, and local graph context, for fine\-grained LLM\-based disambiguation\.

Forrelation exploration and fact acquisition, we organize relational and attribute triples into an in\-memory key\-value database \(Redis\) for efficient neighbor lookups\. Additionally, we pre\-compute the global occurrence frequencies of all relations, which serves as a crucial structural heuristic for the agent to prune high fan\-out paths during exploration\.

##### Unstructured Text Corpus \(Wikipedia\)\.

We employ the real\-time English Wikipedia222[https://en\.wikipedia\.org/w/api\.php](https://en.wikipedia.org/w/api.php)as our unstructured text corpus\. It comprises approximately 7\.1 million entity\-centric articles, totaling over 5 billion words\. Distinct from traditional RAG that chunks text flatly, we process each page to retain its hierarchical structure, including the summary paragraph, table of contents, and sectioned full text\. This structure supports CoG’s hierarchical reading strategy \(global skimming followed by detailed reading\), enabling efficient navigation through long documents\.

Wikipedia complements Wikidata by providing richer natural\-language context, especially for facts that are difficult to normalize into triples\. In contrast, Wikidata provides normalized entities and typed relations for precise symbolic traversal\. CoG exploits this complementarity by using KG facts as high\-precision reasoning anchors and Wikipedia passages as high\-recall contextual evidence\.

## Appendix DAdditional Evaluation Metrics

To complement the primary EM evaluation, Tables[7](https://arxiv.org/html/2609.12791#A4.T7)and[8](https://arxiv.org/html/2609.12791#A4.T8)report LLM\-as\-judgeCorrectrates and token\-level F1 scores, respectively, for the same model outputs as in Table[2](https://arxiv.org/html/2609.12791#S4.T2)\. For LLM\-as\-judge, Qwen3\.5\-122B\-A10B \(non\-thinking mode, temperature 0\) classifies each response asCorrect,Partial,Incorrect, orNo Answer, given only question, reference answers, and model response\. We conservatively report only theCorrectrate\. For token\-level F1, the same model extracts a concise final answer using only the question and response\. We then normalize predictions and references by lowercasing, removing punctuation and articles, and normalizing whitespace\. For multiple references, we retain the maximum F1\.

Baseline TypeMethodMulti\-hop KG\-based QAMulti\-hop text\-based QAAvg\.KGQAGenCWQQALD10\-enWebQSP2WikiMQAAdvHotpotQAMusiQueLLM\-onlyDirect38\.7434\.5740\.8464\.0629\.2023\.3814\.2035\.00CoT38\.2835\.0644\.1460\.2831\.2025\.9715\.4035\.76CoT\-SC39\.4832\.7143\.5461\.0532\.4026\.6214\.8035\.80Text\-based RAGVector RAG50\.2333\.2037\.8464\.8348\.8045\.4518\.2042\.65ReAct48\.1935\.7442\.0469\.7957\.6054\.8722\.8047\.29IRCoT52\.5534\.5737\.8466\.4368\.6061\.6925\.0049\.53Search\-o152\.2739\.8448\.6568\.6047\.8047\.7327\.4047\.47KG\-based RAGToG42\.6329\.2045\.9562\.8734\.8022\.0811\.2035\.53PoG51\.4429\.5949\.8570\.4279\.2019\.8016\.4045\.24DoG43\.6525\.6851\.6563\.2962\.0024\.6813\.8040\.68Hybrid RAGToG\-2253\.5741\.5049\.8570\.2165\.2042\.8622\.4049\.37ProposedCoG66\.8244\.9259\.7676\.5788\.2062\.3432\.8061\.63

Table 7:LLM\-as\-judgeCorrectrate \(%\) on seven datasets\. The best result in each column is highlighted inbold\.Baseline TypeMethodMulti\-hop KG\-based QAMulti\-hop text\-based QAAvg\.KGQAGenCWQQALD10\-enWebQSP2WikiMQAAdvHotpotQAMusiQueLLM\-onlyDirect38\.6433\.1728\.1449\.5933\.1921\.6315\.7731\.45CoT40\.2835\.2534\.3555\.9635\.9425\.1317\.6834\.94CoT\-SC41\.9134\.5935\.2956\.3036\.1424\.5818\.1135\.27Text\-based RAGVector RAG48\.4928\.9824\.4347\.8144\.6136\.8417\.5035\.52ReAct46\.1529\.9025\.5849\.7851\.5542\.7821\.9938\.25IRCoT51\.2630\.3425\.1948\.0859\.8647\.9323\.1340\.83Search\-o149\.1835\.4331\.3951\.4844\.2239\.4425\.6539\.54KG\-based RAGToG43\.3127\.2435\.5858\.2134\.3119\.5113\.2233\.05PoG51\.3026\.4639\.8459\.3573\.4716\.4715\.5640\.35DoG46\.0027\.2043\.2056\.0161\.8421\.1514\.3538\.54Hybrid RAGToG\-2254\.9639\.4638\.5560\.5862\.8037\.8523\.4545\.38ProposedCoG67\.6938\.4637\.9650\.3676\.2249\.9528\.4849\.87

Table 8:Token\-level F1 \(%\) on seven datasets\. The best result in each column is highlighted inbold\.As shown in Tables[7](https://arxiv.org/html/2609.12791#A4.T7)and[8](https://arxiv.org/html/2609.12791#A4.T8), the complementary metrics are consistent with the EM\-based findings\. Under LLM\-as\-judge, CoG achieves the best result on all seven datasets, with an averageCorrectrate of 61\.63%, outperforming the strongest baseline, IRCoT, by 12\.10 points\. Under token\-level F1, CoG also obtains the highest average score of 49\.87%, improving over ToG\-2 by 4\.49 points\. These results show that CoG’s gains are not merely caused by exact string matching, but remain clear under both semantic equivalence judgment and lexical\-overlap evaluation\.

## Appendix EDetailed Results on Backbone LLMs

This section supplements the backbone LLM generalizability analysis in Section[4\.4](https://arxiv.org/html/2609.12791#S4.SS4)\. Table[9](https://arxiv.org/html/2609.12791#A5.T9)presents the detailed performance breakdown across different backbone LLMs, corresponding to the summarized results in Table[4](https://arxiv.org/html/2609.12791#S4.T4)\.

##### Evaluation Setup\.

To balance computational cost with evaluation rigor, we adopted the following dataset selection and sampling strategies:

Dataset Selection\.We excluded the WebQSP dataset from this analysis, as modern LLMs already achieve near\-saturated performance on its simple 1\-2 hop queries in the Direct Prompting setting, making it less discriminative for measuring improvement\.

Open\-source Models\.For large\-scale KG\-based datasets \(KGQAGen and CWQ\), we sampled 300 instances each to align with the scale of QALD10\-en\. For the remaining datasets \(QALD10\-en, 2WikiMQA, AdvHotpotQA, and MusiQue\), we evaluated on the full test sets\.

Proprietary Models\.We evaluated on a sampled subset of 100 examples for each dataset\.

##### Key Observations\.

The detailed results reveal three key insights regarding CoG’s generalizability and cost\-effectiveness: \(1\)Broad Generalizability:CoG consistently improves performance across all backbone models, regardless of their scale \(from 8B to 235B\) or type \(open\-source vs\. proprietary\)\. \(2\)Unlocking Small Models:The relative performance gain is most pronounced on the smallest model, Qwen3\-8B \(\+113\.2%\), showing that CoG’s cognitive architecture effectively compensates for the limited parametric knowledge of smaller LLMs\. \(3\)Cost\-Effectiveness:CoG\-8B \(Avg\. 51\.0%\) outperforms direct prompting on massive models \(e\.g\. Qwen3\-235B 43\.7%, DeepSeek\-V3\.2 38\.0%\) and surpasses strong 32B baselines \(e\.g\., IRCoT 44\.6%, ToG\-2 45\.9%\)\. Since 8B models are cheaper and faster, CoG\-8B offers a highly cost\-effective deployment solution that neutralizes the token overhead of multi\-turn exploration\.

BackboneMethodKG\-based QAText\-based QAAverageKGQAGenCWQQALD2WikiHotpotMusiQKGTextTotalOpen\-Source ModelsQwen3\-32BDirect40\.0037\.0047\.4547\.2020\.138\.4041\.4825\.2433\.36IRCoT53\.8033\.3041\.1071\.6047\.1020\.6042\.7346\.4344\.58Search\-o146\.3436\.7243\.5444\.6040\.2619\.4042\.2034\.7538\.48DoG54\.8033\.1055\.9061\.2020\.1011\.4047\.9330\.9039\.42ToG\-255\.6041\.4053\.5073\.0035\.7016\.2050\.1741\.6345\.90CoG76\.3346\.3355\.2685\.2051\.9527\.8059\.3154\.9857\.15Qwen3\-8BDirect29\.1027\.8336\.3431\.8012\.995\.4031\.0916\.7323\.91CoG68\.0342\.2949\.8580\.0045\.4520\.2053\.3948\.5550\.97Qwen3\-235BDirect54\.6744\.3354\.9555\.2032\.4720\.8051\.3236\.1643\.74CoG79\.0055\.1156\.4687\.6054\.5532\.8063\.5258\.3260\.92gpt\-oss\-120bDirect18\.6729\.6736\.6420\.8018\.838\.0028\.3315\.8822\.10CoG42\.3340\.3345\.9563\.4038\.6418\.8042\.8740\.2841\.58DeepSeek\-V3\.2Direct53\.6745\.3344\.7439\.2031\.1713\.8047\.9128\.0637\.99CoG85\.3351\.6757\.3688\.4059\.0934\.0064\.7960\.5062\.64Proprietary Models \(Sampled Set, N=100\)GPT\-5\.1Direct54\.0047\.0036\.0059\.0040\.0017\.0045\.6738\.6742\.17CoG81\.0049\.0038\.0082\.0055\.0029\.0056\.0055\.3355\.67Gemini\-2\.5\-FlashDirect62\.0046\.0027\.0065\.0046\.0022\.0045\.0044\.3344\.67CoG73\.0044\.0031\.0078\.0058\.0023\.0049\.3353\.0051\.17

Table 9:Detailed performance comparison \(EM, %\) of different backbone LLMs with and without the CoG framework across six datasets \(WebQSP excluded\)\. For Qwen3\-32B, we additionally include strong baselines from various categories \(Text\-based, KG\-based, and Hybrid RAG\) to demonstrate that CoG with a lightweight 8B model can outperform these 32B baselines\.

## Appendix FDetailed Results on Exploration Depth

Table[10](https://arxiv.org/html/2609.12791#A6.T10)provides the full results corresponding to the exploration depth analysis discussed in Section[4\.4](https://arxiv.org/html/2609.12791#S4.SS4)and visualized in Figure[3](https://arxiv.org/html/2609.12791#S4.F3)\. The table lists the Exact Match \(EM\) scores for CoG across exploration depths from 1 to 6 on all seven benchmark datasets, alongside the average performance on KG\-based and Text\-based tasks\.

MethodKG\-based QAText\-based QAAvg\.KGQAGenCWQQALD10WebQSPAvg\.2WikiAdvHotpotMusiQueAvg\.VectorRAG48\.6630\.7639\.0470\.4947\.2452\.6032\.1412\.4032\.3840\.87CoG \(Depth=1\)67\.4737\.9945\.3580\.6357\.8648\.0026\.624\.6026\.4144\.38CoG \(Depth=2\)71\.8342\.5851\.9581\.0561\.8585\.2046\.4320\.0050\.5457\.01CoG \(Depth=3\)74\.2442\.5853\.7581\.7563\.0886\.8049\.3525\.0053\.7259\.07CoG \(Depth=4\)74\.7042\.8755\.2681\.7563\.6585\.2051\.9527\.8054\.9859\.93CoG \(Depth=5\)74\.5142\.9751\.6581\.4762\.6584\.0052\.9226\.0054\.3159\.07CoG \(Depth=6\)75\.9043\.6554\.3580\.5663\.6283\.2053\.2525\.6054\.0259\.50

Table 10:Full results of exploration depth analysis\. We report Exact Match \(EM\) scores for CoG with maximum exploration depths ranging from 1 to 6 on all seven datasets, alongside the VectorRAG baseline\. The best result for each dataset is highlighted inbold\.
## Appendix GDetailed Efficiency Profile

This section details CoG’s computational overhead across token consumption, end\-to\-end latency, and wall\-clock time per retrieval round\.

MethodKGQAGenCWQQALD10\-enWebQSP2WikiMQAAdvHotpotQAMusiQueTokenLatencyTokenLatencyTokenLatencyTokenLatencyTokenLatencyTokenLatencyTokenLatencyReAct3,85014\.13,99613\.73,90813\.83,87012\.33,98418\.83,63113\.27,75820\.0IRCoT23,83232\.926,10728\.923,48333\.722,79819\.522,35041\.523,03838\.229,79846\.1Search\-o112,26298\.413,505119\.810,61184\.09,89162\.619,196140\.511,93277\.920,913120\.0ToG6,55268\.74,16841\.94,15469\.72,96339\.14,77970\.54,94668\.44,69575\.2PoG8,75216\.75,11712\.73,66010\.92,8627\.04,90916\.67,22023\.711,89928\.4DoG15,494168\.710,304133\.93,08820\.63,32018\.16,671105\.410,364158\.78,575134\.0ToG\-24,193109\.73,42478\.63,27353\.33,12751\.33,06742\.73,39851\.04,00895\.0CoG36,323285\.129,465194\.215,63695\.714,20480\.715,508121\.818,958145\.838,876263\.5

Table 11:Token consumption and latency \(seconds\) per question across different methods\. Values represent the median of the dataset to reflect the typical cost for a standard query\.Complexity Adaptability\.CoG dynamically scales resources to query difficulty \(Table[11](https://arxiv.org/html/2609.12791#A7.T11)\)\. For simpler tasks \(WebQSP, 2WikiMQA\), it uses fewer tokens \(∼\\sim14\-15k\) than IRCoT \(∼\\sim22k\) yet achieves higher accuracy\. For complex tasks \(MusiQue, KGQAGen\), it invests more tokens into deep reasoning, yielding substantial gains where efficient methods fail \(\+11\.6% on MusiQue over ToG\-2\)\.

Latency Breakdown\.Figure[4](https://arxiv.org/html/2609.12791#A7.F4)details the average wall\-clock time per retrieval round\. The latency primarily stems from sequential LLM calls in the cognitive cycle\. However, this extended reasoning time supports a fully open\-ended retrieval setting: CoG starts from the raw question without pre\-annotated entities, directly grounds and retrieves evidence, and adaptively adjusts KG/text exploration according to the evolving reasoning state\. Furthermore, this deep filtering ensures precise localization, reducing accessed documents by12\.4×12\.4\\timescompared to ToG\-2 \(Table[5](https://arxiv.org/html/2609.12791#S4.T5)\)\. The current wall\-clock time can be further optimized by parallelizing the dual\-source exploration modules and concurrent sub\-queries\.

![Refer to caption](https://arxiv.org/html/2609.12791v1/figures/time_breakdown_stacked.png)Figure 4:Average wall\-clock time \(seconds\) breakdown per retrieval round across different datasets\.Cost\-Effectiveness\.While CoG consumes more tokens on complex tasks, this is offset by its ability to utilize smaller, cheaper models\. As shown in Appendix[E](https://arxiv.org/html/2609.12791#A5), CoG with an 8B model outperforms strong 32B baselines, suggesting a more favorable accuracy\-cost trade\-off for practical deployment\.

## Appendix HSensitivity Analysis on Entity Linking

To evaluate the robustness of CoG to the candidate retrieval size \(top\-kk\) in the entity linking module, we vary the number of candidate entities from66to3030\. We conduct this analysis on four representative datasets, covering both KG\-based and text\-based QA tasks\. For KGQAGen, we evaluate on a 300\-sample subset to control computational cost\.

kkKGQAGen2WikiHotpotMusiQAvg\.679\.384\.847\.725\.659\.41278\.384\.249\.725\.259\.41874\.385\.850\.026\.259\.12076\.385\.252\.027\.860\.33078\.085\.651\.326\.260\.3

Table 12:Sensitivity analysis of entity\-linking candidate sizekk\. We report EM \(%\) on four representative datasets\.As shown in Table[12](https://arxiv.org/html/2609.12791#A8.T12), CoG is robust to the entity\-linking candidate size\. Acrossk=6k=6to3030, the average EM remains within a narrow range of 59\.1%–60\.3%\. Even with a narrow retrieval scope \(k=6k=6\), CoG achieves a strong average EM of 59\.4%, while increasingkkprovides broader entity recall without causing overall performance degradation\. We setk=20k=20as the default because it achieves the best average performance, tied withk=30k=30, while using fewer candidate entities\. This indicates that CoG’s context\-aware disambiguation effectively filters noisy candidates while benefiting from broader entity recall\.

## Appendix IManual Evaluation and Error Study

As the Exact Match \(EM\) metric strictly relies on string matching, it often fails to evaluate the validity of the underlying reasoning process\. To gain deeper insights, we conduct a manual analysis on a sampled subset\. We assessReasoning Faithfulnessfor cases where the EM score is correct \(EM=1\), and perform anError Diagnosisfor cases where the model is judged incorrect \(EM=0\)\.

### I\.1Reasoning Faithfulness

For predictions judged correct by EM, we further examine whether the model reaches the answer through a faithful reasoning process\. We categorize each EM\-correct prediction into four types:

- •True Positive \(TP\):The reasoning chain is logically sound, and the extracted evidence fully supports the final answer\.
- •Flawed True Positive \(Flawed TP\):The final answer and core reasoning direction are correct, but the reasoning contains minor verification gaps, shortcut steps, or non\-critical factual imperfections\.
- •Weak False Positive \(Weak FP\):The final answer is correct by coincidence, but the core intermediate entities or facts are substantially incorrect, i\.e\., the model is right for the wrong reasons\.
- •False Positive \(FP\):The model fails to deduce the correct answer, but the EM metric falsely judges it correct due to substring matching in the reasoning text\.

Table[13](https://arxiv.org/html/2609.12791#A9.T13)shows that CoG produces the most faithful EM\-correct predictions\. Its severe false\-positive rate \(Weak FP \+ FP\) is only 3\.6%, much lower than ToG\-2 \(12\.7%\) and Self\-Consistency \(29\.1%\)\. Even when Flawed TP is treated as non\-ideal reasoning, CoG remains the most reliable method\.

Self\-Consistency is vulnerable to ungrounded parametric reasoning, often producing hallucinated bridge entities or fabricated attributes \(Weak FPs\), or long CoT traces that accidentally match the gold string \(FPs\)\. ToG\-2 reduces such hallucinations through retrieval, but its reactive exploration can still preserve wrong intermediate entities or unresolved constraints\. CoG’s graph\-text exploration and reflection better ground intermediate steps, so most of its imperfect cases involve incomplete verification of secondary constraints \(Flawed TPs\) rather than broken core reasoning chains\.

MethodTPFlawed TPWeak FPFPSelf\-Consistency60\.0%10\.9%21\.8%7\.3%ToG\-281\.8%5\.5%3\.6%9\.1%CoG \(Ours\)89\.1%7\.3%1\.8%1\.8%Table 13:Distribution of reasoning faithfulness for predictions evaluated as correct by EM\.Figure[5](https://arxiv.org/html/2609.12791#A9.F5)further shows that identical EM scores can hide different reasoning quality\. While SC and ToG\-2 may reach the correct answer through hallucinated or weakly supported intermediate links, CoG derives the answer from a more grounded and faithful reasoning path\. This example also involves a temporal update: although the dataset reference path is based on an older coach, CoG identifies the updated coach and reaches the correct nationality through verifiable evidence\.

Question:What nationality is the sport club that the current coach of Werder Bremen played professionally for?Gold Answer:GermanReference Reasoning Path:Werder Bremen→\\rightarrow\(coach\) Alexander Nouri→\\rightarrow\(played for\) VfL Osnabrück→\\rightarrow\(nationality\) German✗SC \(Weak FP\):Werder Bremen→\\rightarrowFlorian Kohfeldt→\\rightarrow\[Hallucinated\]VfL Wolfsburg→\\rightarrowGerman Hallucinates that coach F\. Kohfeldt played for VfL Wolfsburg \(he only coached them\)\. Hits the answer “German” purely by coincidence\.✗ToG\-2 \(Weak FP\):Werder Bremen→\\rightarrowFlorian Kohfeldt→\\rightarrow\[Guessed\]Werder Bremen→\\rightarrowGerman Fails to retrieve his actual former clubs\. Circularly assumes that since he coaches Werder Bremen \(a German club\), he must have played for them, guessing “German”\.✓CoG \(True Positive\):Werder Bremen→\\rightarrowDaniel Thioune→\\rightarrowVfL Osnabrück→\\rightarrowGerman Identifies current coach D\. Thioune from updated knowledge\. Retrieves his actual former clubs \(e\.g\., VfL Osnabrück\) and confirms they are German\.

Figure 5:A qualitative example showing CoG’s superior reasoning faithfulness despite identical EM scores across models\.
### I\.2Error Diagnosis

To understand the limitations of CoG, we conduct a primary\-cause error diagnosis on a sampled subset of instances where CoG fails the EM evaluation\. As illustrated in Figure[6](https://arxiv.org/html/2609.12791#A9.F6), we categorize the errors into External Factors and Internal Errors\.

![Refer to caption](https://arxiv.org/html/2609.12791v1/figures/manual_error_analysis.png)Figure 6:Taxonomy of error causes for CoG based on manual analysis\.##### External Factors \(71\.1%\):

A large portion of the errors are attributable to benchmark or evaluation limitations\.

- •Metric False Negative \(37\.8%\):The model successfully completes the multi\-hop reasoning but fails the strict string matching\. Common instances include surface\-form mismatch \(aliases or pseudonyms\), paraphrases, or answer granularity differences \(city vs\. metro area\)\.
- •Dataset Flaws \(26\.7%\):These include typos in the questions, grammatically ambiguous prompts leading to misaligned relation extraction, and noisy ground\-truth annotations\.
- •KB Temporal Mismatch \(6\.7%\):Temporal mismatch occurs when the model retrieves updated facts from the knowledge source \(e\.g\., recent sports team transfers\), which conflict with the outdated static dataset ground truth\.

##### Internal Errors \(28\.9%\):

The remaining errors represent genuine limitations in the agentic exploration process\.

- •Exploration Distraction \(13\.3%\):In environments with long texts or ambiguous clues, the agent occasionally gets trapped by irrelevant entities or over\-thinks historical details, exhausting its maximum exploration turns\.
- •Disambiguation \(6\.7%\):The model sometimes overlooks rigid constraints during entity disambiguation \(e\.g\., ignoring a "state school" constraint and erroneously selecting a private school\)\.
- •Reasoning Hallucination \(4\.4%\) & Parametric Guess \(4\.4%\):The model occasionally struggles with counting logic over complex long tables, or bypasses retrieval entirely by relying on over\-confident parametric guesses\.

Overall, this diagnosis shows that raw EM can underestimate CoG, with many failures caused by rigid string matching, noisy annotations, or temporal mismatch\. The remaining internal errors highlight important directions for improvement in exploration focus, entity disambiguation, and evidence\-grounded verification\.

## Appendix JCase Studies

Table[14](https://arxiv.org/html/2609.12791#A10.T14)and Table[15](https://arxiv.org/html/2609.12791#A10.T15)compare the reasoning trajectories of ToG\-2 and CoG on a complex multi\-hop question from AdvHotpotQA\.

##### ToG\-2 Analysis\.

It fails due to its passive, graph\-driven exploration strategy\. The system starts by retrieving general information about “Stanford Cardinal” but fails to locate the specific player due to the absence of statistical attributes in the KG\. Lacking a reflection mechanism, ToG\-2 cannot diagnose this failure\. Instead, it blindly continues its beam search, pivoting to high\-ranking but irrelevant entities like “quarterback” in Turn 3, ultimately leading to an irreversible dead end\.

##### CoG Analysis\.

In contrast, CoG demonstrates robust navigation through its cognitive cycle and bidirectional synergy\. CoG initially encounters the same dead end as ToG\-2 in Turn 1\. However, Reflection diagnoses the strategy as too narrow\. Proactive Planning then pivots to broader queries like “football receiving leaders” instead of the player directly \(Turn 2\)\. Crucially, Text Entity Utilization bridges KG gaps by identifying the entity “James Lofton”, which aligns with the statistical constraints in the question, from Wikipedia related sections\. This bidirectional synergy enables CoG to dynamically identify the target player and verify the specific statistics in Turn 3, successfully deriving the answer “David”\.

Question:What is the middle name of the former Stanford Cardinals player who caught 57 passes for 1010 yards and 14 TDs?Pre\-annotated Entities:Stanford Cardinal \(Q2938060\), Touchdown \(Q650807\)Ground Truth:DavidTurnToG\-2 Reasoning Processturn 1Starting Entities:Stanford Cardinal \(Q2938060\), Touchdown \(Q650807\)Relations Explored:member of sports team, sport, educated at, facet of, named after \(6 relations\)Retrieved Entities:57 entities \(49 from “member of sports team”, 4 from “sport”, 1 from “educated at”, 2 from “Touchdown” relations\)Notable: 49 Stanford athletes including Greg Camarillo, John Elway, Mark Marquess, etc\.Document Retrieval:Retrieved Wikipedia pages for 55 entities \(2 pages failed: sports terminology, Margaret Hayden\)Issue:No specific statistics matching 57/1010/14 found in documentsReasoning:Information insufficient \- cannot identify the specific playerEntity Ranking \(for next turn\):\[0\.28\] Greg Camarillo \| \[0\.12\] John Elway \| \[0\.05\] Mark Marquessturn 2Starting Entities:Greg Camarillo \(Q1248387\), John Elway \(Q432931\), Mark Marquess \(Q6768732\)Relations Explored:given name, educated at, member of sports team, position played, occupation \(9 relations\)Retrieved Entities:11 entities \(Greg, Menlo\-Atherton HS, Stanford Univ\., 5 NFL teams, John, quarterback, Mark, baseball player, Stanford Cardinal\)Document Retrieval:Retrieved Wikipedia pages for all 11 entitiesIssue:Found Greg Camarillo’s given name but no middle name; no confirmation of statisticsReasoning:Cannot confirm Greg Camarillo is the target player or find his middle nameEntity Ranking \(for next turn\):\[0\.45\] Stanford Cardinal \| \[0\.00\] quarterbackturn 3Starting Entities:Stanford Cardinal \(Q2938060\), quarterback \(Q622747\)Relations Explored:member of sports team, position played, sport \(6 relations\)Retrieved Entities:106 entities \(50 from “member of sports team”, 4 from “sport”, 1 from “educated at”, 50 from “position played”, 1 from “part of”\)Notable: 50 quarterbacks \(Logan Thomas, John Brantley, Charlie Whitehurst, etc\.\), 50 Stanford athletesDocument Retrieval:Retrieved Wikipedia pages for 103 entities \(3 pages failed: Cameron Dantley, Dai Minagawa, Margaret Hayden\)Critical Failure:Explored wrong position \(quarterback vs\. wide receiver\)No Reflection:System continued beam search without recognizing strategic misalignmentEntity Ranking:\[0\.31\] Logan Thomas \| \[0\.12\] John Brantley \| \[0\.02\] Charlie WhitehurstFinal Reasoning:Information insufficient to identify the player or middle nameOutcome:FAILURE\- Generated answer without evidenceTable 14:Reasoning trace of ToG\-2\. The method employs a rigid beam search where the next exploration steps are determined by ranking score based on entity document relevance\. Without reflection, the pruning mechanism blindly discards potentially correct paths and misguides the search towards irrelevant high\-ranking entities, leading to an irreversible failure\. Red highlights indicate critical failure analysis for the system\.Question:What is the middle name of the former Stanford Cardinals player who caught 57 passes for 1010 yards and 14 TDs?Ground Truth:DavidTurnCoG Reasoning ProcessTurn 1Planning Phase:Analysis: “To determine the middle name, I first need to identify the specific player who caught 57 passes for 1010 yards and 14 touchdowns\.”Query: “Stanford Cardinals player with 57 catches, 1010 yards, 14 TDs”Entity: “Stanford Cardinals player”Exploration Phase:KG:Entity linking failed \- 9 candidates all team\-level entities \(e\.g\., Stanford Cardinal football, Stanford Cardinal men’s soccer\), no individual player entitiesWikipedia:Searched “Stanford Cardinal football” page, extracted team context \(Jim Plunkett, Andrew Luck\) but no player matching the statisticsSynthesis:No player\-specific information foundReflection:Judgment = INSUFFICIENT\_USELESS“The initial approach was too narrow… The core strategic error was not breaking the problem into smaller, more general steps\.”Turn 2Recovery Planning:Strategy Shift Reflection: “Instead of starting with the player’s name, we should first identify the season or year when these stats might have been achieved, or search for a list of Stanford receivers with notable seasons\.”Updated Analysis: “Shift focus to general sources of Stanford football statistics or notable players\.”Next Queries: \[“Stanford football all\-time receiving leaders”, “Stanford football players with 14 TDs in a season”\]Exploration \(Query: “Stanford football all\-time receiving leaders”\):KG:Linked to “Stanford Cardinal football statistical leaders” \(Q19878473\)Relation Discovery: Found 1 relation \- “sport” \(P641\)→\\rightarrowAmerican footballFact Pruning: Kept 0 facts \(too general, not useful for identifying specific players\)Wikipedia:Found “Stanford Cardinal football statistical leaders” page with “Receiving” section“Receiving” section containing 9 statistical tables, extracted the following information from table:“Single season 6” \(receiving yards\): James Lofton \- 1010 yards \(1977\)“Single season 7” \(receiving TDs\): James Lofton \- 14 TDs \(1977\); J\.J\. Arcega\-Whiteside \- 14 TDs \(2018\)Key Discovery:Identified “James Lofton” as candidate with 2/3 statistics matched \(1010 yards \+ 14 TDs in 1977\)Synthesis:Strong candidate found but 57 receptions unconfirmedReflection:Judgment = INSUFFICIENT\_USEFUL \- Continue with James LoftonTurn 3Planning Phase:Query: “James Lofton 1977 season stats”Entities: “James Lofton”Exploration Phase:KG:Linked to James Lofton \(Q1680714\)Identity Check:educated at→\\rightarrowStanford;member of team→\\rightarrowStanford Cardinal\.Attribute Retrieval:Found alias “James David Lofton” \(Directly reveals middle name\)Wikipedia:Found “James Lofton” pageFrom “College career” section:Confirmed “57 receptions for 1, 010 yards and 14 touchdowns during the 1977 season”Synthesis:KG confirmed identity & name; Text verified the missing statistical constraint\. Middle name derivation, complete\.Reflection:Judgment = SUFFICIENTFinal Answer:“The middle name of the former Stanford Cardinals player is David\.”Outcome:SUCCESSin 3 turnsTable 15:Reasoning trace of CoG\. Reflection and Proactive Planning diagnose the initial failure and recover from dead ends\. Adaptive Entity Linking identifies implicitly useful entities \(“1977 Stanford Cardinals football team”\) not directly mentioned in the question\. Finally, Text Entity Utilization effectively extracts the target entity \(“James Lofton”\) from text to guide the final answer derivation\. Purple highlights show successful reflection and strategic adjustment; blue highlights show key information extraction from dual sources \(KG structure \+ Wikipedia text\)\.

## Appendix KPrompts

This section provides the main prompt used in CoG to guide LLM reasoning at each stage of the cognitive cycle\.

Table[16](https://arxiv.org/html/2609.12791#A11.T16)presents the prompt used for theinitial planning phase\(Section[3\.2\.1](https://arxiv.org/html/2609.12791#S3.SS2.SSS1)\)\. The prompt includes four examples to guide the LLM in handling diverse multi\-hop reasoning scenarios\.

Tables[17](https://arxiv.org/html/2609.12791#A11.T17)–[20](https://arxiv.org/html/2609.12791#A11.T20)present the prompts for the three\-stageKG Exploration\(Section[3\.2\.2](https://arxiv.org/html/2609.12791#S3.SS2.SSS2)\): Entity Linking, Relation Discovery, and Fact Pruning, respectively\. These prompts demonstrate how CoG leverages in\-context learning to achieve precise, schema\-aware navigation over large\-scale KGs\.

Tables[21](https://arxiv.org/html/2609.12791#A11.T21)–[24](https://arxiv.org/html/2609.12791#A11.T24)detail the prompts used in theText Exploration module\(Section[3\.2\.2](https://arxiv.org/html/2609.12791#S3.SS2.SSS2)\), covering Adaptive Page Selection \(Tables[21](https://arxiv.org/html/2609.12791#A11.T21)and[22](https://arxiv.org/html/2609.12791#A11.T22)\) and Hierarchical Reading \(Tables[23](https://arxiv.org/html/2609.12791#A11.T23)and[24](https://arxiv.org/html/2609.12791#A11.T24)\)\.

Table[25](https://arxiv.org/html/2609.12791#A11.T25)presents the prompt for theSynthesis module\. Tables[26](https://arxiv.org/html/2609.12791#A11.T26)and[27](https://arxiv.org/html/2609.12791#A11.T27)provide examples of structured evidence formats for KG and text, respectively, that populate the$\{evidence\_blocks\}placeholder in the Synthesis prompt\.

Tables[28](https://arxiv.org/html/2609.12791#A11.T28)and[29](https://arxiv.org/html/2609.12791#A11.T29)detail the prompts for theReflection module\(Section[3\.2\.3](https://arxiv.org/html/2609.12791#S3.SS2.SSS3)\), enabling the system to either deepen exploration based on new findings or pivot its strategy by diagnosing failures from the interaction history\.

ROLEYou are a highly strategic retrieval planner\. Your function is to analyze a complex question and identify the immediate, parallelizable search actions required to proceed\.TASKGiven a user’s question, do NOT provide the final answer\. Instead, determine the next logical search queries\. A single question might require multiple parallel queries to gather the necessary initial information\. Your plan must include your reasoning, a list of search queries, and a corresponding list of entities\.CONSTRAINTS\- The number of queries in the ‘Query’ list must not exceed 5\.
\-\[CRITICAL\]The ‘Query’ and ‘Entities’ lists must have the exact same number of items\. For each query, the corresponding item in the ‘Entities’ list must be thesingle, most specific, and central named entitybeing investigated in that query\.
\- Only output the query/queries for the immediate next step\. Do not plan, describe, or allude to any subsequent steps\.OUTPUT FORMATYour output must follow this exact structure, with no additional commentary:
Analysis:Your thought process explaining why these next steps are necessary and what information is being sought\.
Query:\[A Python\-style list of concise and effective search query strings\.\]
Entities:\[A Python\-style list of the core entities in the Query, corresponding one\-to\-one with the Query list\.\]EXAMPLESExample 1:
Question:What is the nationality of one of the men for whom the Schumann–Runge bands are named?
Output:
Analysis:The question requires the nationality of a person\. Before I can find their nationality, I must first identify the individuals the "Schumann–Runge bands" are named after\.
Query:\["who are the Schumann\-Runge bands named after"\]
Entities:\["Schumann–Runge bands"\]… \(Other examples omitted for brevity\) …Example 4:
Question:Where did the leader of the largest European country after the collapse of the country that denied anything more than an advisory role in the Korean war die?
Output:
Analysis:The question is complex and requires multiple pieces of information\. First, I need to identify which country denied anything more than an advisory role in the Korean War\. \[…\] I will begin by identifying the country that denied a combat role in the Korean War\.
Query:\["country that denied anything more than an advisory role in Korean War"\]
Entities:\["Korean War"\]YOUR TASKQuestion:$\{question\}
Output:Table 16:Prompt template for the Initial Planning module\. The LLM is instructed to analyze the question, generate parallelizable sub\-queries, and identify corresponding anchor entities\. This structured output initializes the exploration cycle\.ROLEYou are an expert in Knowledge Graph entity linking\. Your task is to disambiguate an entity mention from a user’s question by matching it to the correct entity in a knowledge graph, using the surrounding context\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Current Sub\-Query:$\{query\}
\-Entity Mention to Link:$\{entity\}CANDIDATE ENTITIESHere are the top candidate entities in the Knowledge Graph, sorted by a preliminary relevance score\. Each candidate includes its Wikidata QID, label, description, aliases, popularity, some of its neighbors, and relevance score\.
$\{formatted\_candidates\}YOUR TASKYour task is to critically evaluate the candidate entities based on the provided CONTEXT\. Your goal is to either identify the single correct entity OR determine that no suitable match exists\.•Analyze the Context:Carefully review the ’Original Question’ and ’Overall Plan’\. What are the key details about the entity$\{entity\}\(e\.g\., their time period, relationships, role\)?•Evaluate Each Candidate:For each candidate, compare itsDescription,Aliases, andNeighborhoodagainst the context\. A correct match should be consistent with the context\.•Make a Decision:–If, and only if,you find one candidate that is a confident and accurate match for$\{entity\}based on all available information, your output should be its QID on a single line\.–If none of the candidates are a confident match,or if their key details contradict the context, you MUST output the single word:NO\_MATCH\.OUTPUT FORMAT•If a confident match is found, your entire output MUST be only the QID of that entity \(e\.g\., Q12345\)\.•If no confident match is found, your entire output MUST be the single word:NO\_MATCH\.•Your output must not contain any other text, explanation, or reasoning\.YOUR RESPONSE:Table 17:Prompt template for the Entity Linking module\. The LLM is tasked with precise disambiguation by comparing candidate profiles against the question context\. The placeholder$\{formatted\_candidates\}is populated with structured candidate data, as illustrated in Table[18](https://arxiv.org/html/2609.12791#A11.T18)\.Example of Formatted Candidates\-\-\-
\[Entity\]
\- QID: Q716680
\- Label: Steve McQueen
\- Description: American actor \(1930\-1980\)
\- Aliases: Terrence Stephen McQueen, King of Cool
\- Popularity \(Degree\): In: 154, Out: 45, Attr: 22
\[Neighborhood\]
\- Outgoing Relations \(as Head\):
\- spouse: Neile Adams, Ali MacGraw, Barbara Minty
\- child: Chad McQueen, Terry Leslie McQueen
\[Scores\]
\- Final: 0\.952 \(Name similarity=1\.000, Popularity=0\.850, Description=0\.920, Neighbor=0\.880\)
\-\-\-
\.\.\. \(Other candidates omitted\) \.\.\.Table 18:An example of the formatted candidate data populated into the$\{formatted\_candidates\}slot in Table[17](https://arxiv.org/html/2609.12791#A11.T17)\. This structured format provides the LLM with comprehensive entity details \(profile, neighborhood, and retrieval scores\) for disambiguation\.ROLEYou are an expert Knowledge Graph analyzer\. Your task is to select the most relevant relations \(properties\) of a given entity that will help answer a specific question\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Current Sub\-Query:$\{query\}
\-Entity in Focus:$\{entity\_label\}\($\{entity\_qid\}\):$\{entity\_description\}AVAILABLE RELATIONSThe entity$\{entity\_label\}is connected to$\{total\_relations\_count\}relations \(Outgoing:$\{outgoing\_count\}, Incoming:$\{incoming\_count\}\) in the Knowledge Graph\. Below is a list of all relations connected to the entity\. Each relation includes its label, PID, and a frequency indicating how many other entities in the graph are linked via this relation\.
Outgoing Relations:
$\{outgoing\_relations\}
Incoming Relations:
$\{incoming\_relations\}YOUR TASKBased on theCONTEXT, select relations that will help find the answer using a two\-pronged approach:1\.Direct Relations: Select relations that seem to directly contain the answer\.2\.Exploratory Relations: If no direct relations exist, select relations that could lead to intermediate entities, which might then contain the answer\.OUTPUT FORMATYour output must follow this exact structure, with no additional commentary:
Reasoning:Your brief thought process explaining why you chose these specific relations based on the question and the entity\.
Selected PIDs:\[A Python\-style list of strings, where each string is the PID of a selected relation \(e\.g\., \["P31", "P17"\]\)\. If no relations seem relevant, output \[\]\]YOUR RESPONSE:Table 19:Prompt template for the Relation Discovery module\. The LLM selects a subset of relations relevant to the sub\-query to prune the search space at the schema level\.ROLEYou are an expert assistant specializing in knowledge graph analysis for question answering\. Your mission is to intelligently prune a list of facts, guiding a multi\-step exploration process\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Current Sub\-Query:$\{query\}
\-Entity in Focus:$\{entity\_label\}AVAILABLE FACTSBelow is a structured list of all facts retrieved from the Knowledge Graph for the entity$\{entity\_label\}\. The facts are categorized by relation type \(Outgoing or Incoming\)\.
$\{formatted\_facts\}YOUR TASKYour goal is to decide which facts to keep\. Evaluate the facts using a two\-pronged approach:1\.Directly Relevant Facts: Keep any facts that directly help answer theCurrent Sub\-Query\.2\.Promising Intermediate Entities: Keep facts that represent entities which are promising stepping stones\. A fact is "promising" if exploring it further is highly likely to lead to the answer or provide crucial context\.Discard facts that are clearly irrelevant, noisy, or are just general information\.OUTPUT FORMATYour outputMUSTbe a single, valid JSON object with the following structure:```
{
    "reasoning": "Structured thought process...",
    "pruned_facts": {
      "outgoing": { "P17": ["kept fact labels"], ... },
      "incoming": { "P802": ["kept fact labels"], ... }
    }
  }
```

YOUR RESPONSE:Table 20:Prompt template for the Fact Pruning module\. The LLM performs fine\-grained filtering of facts to retain only critical evidence or promising exploration leads\.ROLEYou are a research agent resolving an ambiguous search query on Wikipedia\.TASKYour search for "$\{entity\}" led to a disambiguation page with multiple possible meanings\. You must carefully analyze the full context provided below to choose the single most relevant link from the options\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Current Sub\-Task \(Query\):$\{query\}
\-Ambiguous Search Query:"$\{entity\}"OPTIONS$\{options\_list\}YOUR DECISIONAnalyze the options based on the context to select the best fit\. Your output must be a single line containing only the exact title of the chosen page from the list\. If none of the options seem relevant for answering the original question, output the string "NO\_MATCH"\.YOUR RESPONSE:Table 21:Prompt template for theDisambiguationstep in Adaptive Page Selection\. The LLM resolves ambiguous entities by selecting the correct page from disambiguation options based on context\.ROLEYou are a research agent trying to find the right information on Wikipedia after a search query failed\.TASKYour search for "$\{entity\}" did not find a matching Wikipedia page\. Use the contextual information and the suggestions provided to decide on the best query for your next attempt\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Current Sub\-Task \(Query\):$\{query\}
\-Failed Search Query:"$\{entity\}"SUGGESTIONSBelow are suggestions from the Wikipedia search API to help you refine your query\.
"Did you mean?":This is the API’s top recommendation, often correcting a typo or suggesting a more standard page title\.
\- Suggestion:$\{suggestion\}
Similar Pages Found:These are pages with titles that are textually similar to your failed query\. One of them might be the correct page under a slightly different name\.
\- Similar Pages:$\{search\_results\_list\}YOUR DECISIONBased on the context and the suggestions, choose the best query for your next search attempt\. This could be the "Did you mean?" suggestion, one of the similar pages, or a completely new query you formulate based on the feedback from this failed search\. Your output must be a single line containing only the new search query\. If none of the suggestions seem useful for answering the original question, output the string "NO\_MATCH"\.YOUR RESPONSE:Table 22:Prompt template for theSearch Refinementstep in Adaptive Page Selection\. The LLM uses API feedback \(corrections and similar pages\) to recover from search failures\.ROLEYou are a research agent tasked with answering a complex question by navigating Wikipedia\.TASKYou have been provided with the summary, an infobox table, and the section list of a Wikipedia page relevant to your current query\. Your goal is to extract all useful information from the summary and infobox, identify promising sections for deeper investigation, or determine that the page is irrelevant\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Current Search Query:"$\{query\}"
\-Retrieved Wikipedia Page Title:"$\{page\_title\}"AVAILABLE INFORMATIONPage Summary:
$\{page\_summary\}
Summary Infobox:
$\{infobox\_table\}
Page Sections \(Top\-Level\):
$\{page\_sections\}YOUR DECISIONBased on the information above, what is your next best action? Choose one of the following two options\.1\.If the page seems relevant:•ExtractDirect InformationandPromising Cluesfrom the summary/infobox\.•Identify sections for deeper investigation\.2\.If the page is clearly irrelevant:Explain why and suggest a better search query\.YOUR RESPONSE:Table 23:Prompt template for the Global Skimming module\. The LLM assesses page relevance, extracts high\-level evidence from the summary and infobox, and selects promising sections for detailed reading\.ROLEYou are a meticulous research agent\. Your task is to analyze a section of a Wikipedia page that contains both text and tables to extract relevant information for a given query\.TASKYou have been given several retrieved text chunks and a preview of all tables found within a specific Wikipedia section\. Your goal is to:1\.ExtractDirect InformationandPromising Cluesfrom BOTH theRetrieved Text Chunksand theTable Previews\.2\.Analyze table previews\. If a preview is insufficient but promising, select the table for a full read\.3\.Provide a single, unified rationale that explains both your information extraction findings and your table selections\.CONTEXT\-Original Question:$\{question\}
\-Current Search Query:"$\{query\}"
\-Section Being Investigated:"$\{section\_title\}"
\-Section Exploration Rationale \(during summary reading\):$\{exploration\_rationale\}AVAILABLE INFORMATION1\. Retrieved Text Chunks:\(Top$\{k\}relevant chunks\)
$\{context\_chunks\}
2\. Table Previews:\(Previews of tables:$\{table\_names\_in\_section\}\)
$\{tables\_preview\}OUTPUT FORMATRationale:A consolidated explanation covering both text and tables\.
Extracted Info:Key info from text chunks and table previews\. State "None" if nothing relevant is found\.
Selected Tables:List of table names requiring a full read \(e\.g\., \["Awards"\]\)\. Empty list \[\] if none\.YOUR RESPONSE:Table 24:Prompt template for theDetailed Readingphase\. The LLM performs joint analysis of retrieved text chunks and table previews to synthesize fine\-grained evidence\.ROLEYou are a master AI strategist leading a multi\-hop question\-answering mission\. Your task is to synthesize retrieved information from various sources, evaluate progress against the overall plan, and decide the most logical next step\.CONTEXT\-Original Question:$\{question\}
\-Overall Plan \(Analysis\):$\{analysis\}
\-Notebook \(Summary of Known Facts\):
$\{notebook\}
\-Current Sub\-Queries:$\{queries\}
\-Core Entities in Sub\-Queries:$\{entities\}EVIDENCEThis section contains the information retrieved from different sources for all sub\-queries executed in this turn\.
$\{evidence\_blocks\}YOUR TASKCarefully review all evidence, and in conjunction with theOriginal Questionand yourOverall Plan, complete the following three steps:1\.Verbatim Information Extraction:Meticulously extract all useful information\. Your goal is to faithfully transfer potentially relevant information to your ‘Extracted Content’\. Include:•Direct Facts:Core facts that directly contribute to answering the original question\.•Promising Leads:New entities or critical factual clues essential for guiding the next step\.•\[CRITICAL\]Do NOT summarize or rephrase\. This is for extraction only\.2\.Think Step\-by\-Step:Document your thought process\.•Explain how the direct facts help answer the question\.•Discuss the potential value of promising leads and how they might be explored\.•Identify what key information is still missing\.•If evidence is useless, explainwhythe current sub\-queries failed\.3\.Make a Judgment:Choose one of the following options:•SUFFICIENT: Information is adequate to generate a final, complete answer\.•INSUFFICIENT\_USEFUL: Valuable clues found, but more information is needed\. Continue investigation based on the current findings\.•INSUFFICIENT\_USELESS: Information is irrelevant or has led to a dead end\. A new strategy is needed\.OUTPUT FORMATThought Process:Your step\-by\-step thinking process…
Extracted Content:A structured collection of key facts and promising new leads…
Judgment:SUFFICIENT, INSUFFICIENT\_USEFUL, or INSUFFICIENT\_USELESS\.YOUR RESPONSE:Table 25:Prompt template for theSynthesismodule\. The LLM aggregates dual\-source evidence, extracts key insights, and judges the current progress to determine the next action \(answer, continue, or recover\)\. Examples of the content for$\{evidence\_blocks\}are shown in Tables[26](https://arxiv.org/html/2609.12791#A11.T26)and[27](https://arxiv.org/html/2609.12791#A11.T27)\.Example of Formatted CandidatesKG Exploration for Mention: "John Cage"\[Entity Linking\] \- Linked Entity: John Cage \(Q180727\) \- Description: American composer and music theorist \- Candidates \(top\-4 preview\): \- John Cage \(Q180727\): American composer and music theorist \- John Cage \(Q5347597\): Fictional character from Ally McBeal \- Linking Rationale: The query context discusses "4’33" and "prepared piano", which are signature works of the composer John Cage\.

\[Retrieved Facts for "John Cage"\] \[Attributes\] \- date of birth: \[’1912\-09\-05’\] \- occupation: \[’composer’, ’philosopher’, ’artist’\] \[Outgoing\] \- notable work: \["4’33’’", ’Music of Changes’, ’Imaginary Landscape No\. 4’\] \- student of: \[’Arnold Schoenberg’, ’Henry Cowell’\] \[Incoming\] \- influenced by: \[’Erik Satie’, ’Marcel Duchamp’, ’D\. T\. Suzuki’\]

\[Filtering Summary\] \- Relations explored: 5 of 21 total \- Facts kept: 12 of 43 total

\[Reasoning\] \- Relation Selection: Selected relations regarding works, influences, and personal life relevant to his artistic development\. \- Fact Pruning: Kept only major works and key figures like Schoenberg and Cunningham; discarded minor administrative categories\.

Table 26:An example of structured KG evidence formatted for the$\{evidence\_blocks\}in the Synthesis module\. It includes the linked entity, verified facts \(attributes and relations\), and a reasoning trace for the pruning process\.Example of Formatted CandidatesWikipedia Retrieval Results for entity: "John Cage"Information Extraction:\-Page Title:John Cage\-All Page Sections:\[’Life’, ’Music’, ’Visual art\.\.\.’, \.\.\.\]\-A\. Skimming Summary and Section Selection:\-Rationale:The summary highlights Cage as a pioneer of indeterminacy and the prepared piano\. To understand his specific methods, we need to explore the "Music" section\.\-Selected Sections for Deeper Analysis:\[’Music’\]\-B\. Extracted Content:\-From Summary:
John Cage was a pioneer of indeterminacy in music\. Best known for "4’33’’", a silent composition\. He developed the "prepared piano" and used the "I Ching" as a standard composition tool\.\-From Sections:\-Section: "Music"\-Rationale for section processing:Contains detailed descriptions of his composition techniques like chance operations and rhythmic structures\.\-Extracted from Text:
\- In 1951, Cage started using theI Chingto compose using chance, imitating nature’s manner of operation\.
\-Music of Changes\(1951\) was the first major work created using this method\.
\-Cheap Imitation\(1969\) is a chance\-controlled reworking of Erik Satie’s Socrate\.Table 27:An example of Text evidence formatted for the$\{evidence\_blocks\}in the Synthesis module\. It summarizes the high\-level page content and provides fine\-grained details extracted from specific sections relevant to the query\.ROLEYou are a master AI strategist leading a multi\-hop question\-answering mission\. Your task is to plan the next step of the investigation after an information\-gathering turn that was useful but insufficient\.CONTEXT\-Original Question:$\{question\}
\-Current Notebook:$\{notebook\}
\-Previous Overall Plan:$\{analysis\}
\-Previous Sub\-Queries:$\{queries\}
\-Candidate Entities Pool:$\{candidate\_entities\_pool\}NEW FINDINGS\-Thought Process:$\{thought\_process\}
\-Extracted Content:$\{extracted\_content\}YOUR TASKPlan the next round of investigation to dig deeper and bridge information gaps\.1\.Update Notebook:Combine current notebook with new findings into a single, coherent summary, retaining all unique and relevant details\.2\.Update Analysis:Revise the overall plan to reflect new understanding\. Explain what the immediate next step should focus on and why\.3\.Plan Next Queries:Define a new set of sub\-queries and corresponding core entities based on the updated analysis\.4\.Manage Candidate Pool:Review existing leads and identify new promising entities from the new findings\. Update the pool by adding new leads and removing promoted ones\.OUTPUT FORMATYour output must follow this exact structure:
Thought Process:Your step\-by\-step reasoning\.
Updated Notebook:The comprehensive summary of all known facts\.
Updated Analysis:Your revised analysis and plan\.
Next Queries:\[List of concise and effective search query\.\]
Next Entities:\[List of core entities corresponding to queries\]
Updated Candidate Pool:\[List of dictionaries, e\.g\., \{"entity": "Name", "reason": "…"\}\]YOUR RESPONSE:Table 28:Prompt template forContinue Explorationin the Reflection module\. The LLM updates the notebook and analysis based on new findings and plans the next steps to deepen the investigation\.ROLEYou are a master AI strategist leading a multi\-hop question\-answering mission\. Your task is to recover from a failed information\-gathering turn where the retrieved evidence was useless\.CONTEXT\-Original Question:$\{question\}
\-Current Notebook:$\{notebook\}
\-Candidate Entities Pool:$\{candidate\_entities\_pool\}
\-Interaction History:$\{interaction\_history\}FAILED TURN DETAILSThe last exploration turn was deemed unproductive\. Here’s what went wrong:
\-Previous Overall Plan:$\{analysis\}
\-Failed Sub\-Queries:$\{queries\}
\-Failed Core Entities:$\{entities\}
\-Extracted Content:$\{extracted\_content\}
\-Reasoning for Failure:$\{thought\_process\}YOUR TASKThe previous approach hit a dead end\. Critically reflect on the history, diagnose the error, and pivot the strategy\.1\.Critical Reflection:Analyze why the previous approach failed \(e\.g\., flawed plan, wrong entities\)\. Summarize the core strategic error and derive actionableguiding principlesfor the next attempt\.2\.Update Analysis:Propose a fundamentally new plan that leverages insights from reflection\. Consider promoting leads from the Candidate Pool, re\-examining the original question for missed keywords, or formulating queries from an entirely different angle\.3\.Plan Next Queries:Define a new set of queries that represent a clear change in direction from the failed ones\.4\.Manage Candidate Pool:Review the pool\. Decide if existing leads are now high\-priority, add any new promising leads discovered incidentally, and generate the updated pool by carrying over unused leads while removing promoted ones\.OUTPUT FORMATYour output must follow this exact structure:
Thought Process:Critical reflection on failure and reasoning for the new plan\.
Updated Analysis:The revised analysis and new strategic direction\.
Next Queries:\[List of concise and effective search query\.\]
Next Entities:\[List of core entities corresponding to queries\.\]
Updated Candidate Pool:\[List of updated candidate dictionaries, e\.g\., \{"entity": "Name", "reason": "…"\}\]YOUR RESPONSE:Table 29:Prompt template forStrategy Adjustmentin the Reflection module\. The LLM diagnoses the failure using interaction history and pivots the strategy by generating entirely new queries or backtracking to candidate entities\.