F$^{2}$DR: A Fine-Grained Full-Pipeline Reward Framework for DeepSearch Workflows

# F2DR: A Fine-Grained Full-Pipeline Reward Framework for DeepSearch Workflows
Source: [https://arxiv.org/html/2609.19827](https://arxiv.org/html/2609.19827)
Bojian XiongWentao DingAffiliation:Baidu Inc\., Beijing, ChinaEmail:[dyxiong@tju\.edu\.cn](mailto:)Yujing LuAffiliation:Baidu Inc\., Beijing, ChinaShaowei ZhangAffiliation:TJUNLP Lab, Tianjin University, Tianjin, ChinaLing ShiAffiliation:TJUNLP Lab, Tianjin University, Tianjin, ChinaJing LiaoAffiliation:Baidu Inc\., Beijing, ChinaYan WangAffiliation:Baidu Inc\., Beijing, ChinaYueyang ZhangAffiliation:Baidu Inc\., Beijing, ChinaLong XiaAffiliation:Baidu Inc\., Beijing, ChinaZhiyuan SunAffiliation:Baidu Inc\., Beijing, ChinaDaiting ShiAffiliation:Baidu Inc\., Beijing, ChinaJingzhou HeAffiliation:Baidu Inc\., Beijing, ChinaYuqi RenAffiliation:TJUNLP Lab, Tianjin University, Tianjin, ChinaDeyi XiongAffiliation:TJUNLP Lab, Tianjin University, Tianjin, China

###### Abstract

With the widespread industrial deployment of Large Language Models \(LLMs\), DeepSearch has emerged as the dominant paradigm for resolving complex user queries\. It typically operates through an iterative closed\-loop workflow consisting of planning and reflection, information retrieval, and answer generation\. However, existing reward models \(RMs\) and evaluation benchmarks are primarily designed for static single\-turn tasks, failing to capture the full\-pipeline complexity of DeepSearch workflows\. To address this limitation, we proposeF2DR, a fine\-grained full\-pipeline DeepSearch reward framework\. F2DR evaluates DeepSearch workflows across three dimensions: Content, Trajectory, and Answer, enabling comprehensive process\-level assessment\. We further constructDeepSearch RM\-Bench, a dedicated benchmark for evaluating RMs in DeepSearch scenarios\. Extensive experiments demonstrate that F2DR achieves significantly higher evaluation consistency than self\-evaluation\-based baselines, while DeepSearch RM\-Bench exhibits strong discriminative capability across existing open\-source RMs\. We will publicly release the complete DeepSearch RM\-Bench dataset soon\.

11footnotetext:These authors contributed equally to this work\.22footnotetext:Corresponding authors\.## 1Introduction

With the industrial\-scale deployment of large language models \(LLMs\), user demands for information acquisition have shifted from simple factoid retrieval to complex knowledge\-intensive services\. In this context, DeepSearch[Li et al\. \(2025a\)](https://arxiv.org/html/2609.19827#bib.bib1);[Deng et al\. \(2025\)](https://arxiv.org/html/2609.19827#bib.bib2);[Chen et al\. \(2025a\)](https://arxiv.org/html/2609.19827#bib.bib3);[Team et al\. \(2025\)](https://arxiv.org/html/2609.19827#bib.bib4);[Zhou et al\. \(2026\)](https://arxiv.org/html/2609.19827#bib.bib31)has emerged as a dominant paradigm for autonomous information exploration through iterative cycles of planning\-reflection, information retrieval, and answer generation\. Unlike single\-turn question answering systems[Haas et al\. \(2025\)](https://arxiv.org/html/2609.19827#bib.bib5), DeepSearch operates as a multi\-stage workflow involving long\-horizon reasoning, tool invocation, and multi\-source evidence integration, thereby introducing fundamental challenges for evaluation\. Accurately assessing such workflows requires evaluation methods capable of capturing multiple dimensions of system behavior\. In industrial practice, generation quality is typically assessed through automated feedback provided by reward models \(RMs\)\. However, existing RMs are predominantly designed for static or single\-step scenarios, falling short of the process\-level evaluative requirements of DeepSearch scenarios\.

Existing RMs mainly fall into two paradigms, both of which are inadequate for DeepSearch\. Discriminative RMs[Liu et al\. \(2024a\)](https://arxiv.org/html/2609.19827#bib.bib6);[Liu et al\. \(2025a\)](https://arxiv.org/html/2609.19827#bib.bib7);[Cai et al\. \(2024\)](https://arxiv.org/html/2609.19827#bib.bib8);[Wang et al\. \(2024a\)](https://arxiv.org/html/2609.19827#bib.bib9)provide only scalar scores without explicit reasoning, failing to interpret complex multi\-step planning\. Generative RMs[Liu et al\. \(2025b\)](https://arxiv.org/html/2609.19827#bib.bib10);[Chen et al\. \(2025c\)](https://arxiv.org/html/2609.19827#bib.bib11);[Yu et al\. \(2025\)](https://arxiv.org/html/2609.19827#bib.bib12);[Qin et al\. \(2026\)](https://arxiv.org/html/2609.19827#bib.bib37);[Liang et al\. \(2026\)](https://arxiv.org/html/2609.19827#bib.bib36), despite their interpretability, are prone to hallucinations and poor adaptability, failing to meet strict factual accuracy requirements\. Beyond the limitations of RMs, existing RM benchmarks are also poorly aligned with DeepSearch workflows[Lambert et al\. \(2024\)](https://arxiv.org/html/2609.19827#bib.bib13);[Malik et al\. \(2025\)](https://arxiv.org/html/2609.19827#bib.bib14);[Liu et al\. \(2024b\)](https://arxiv.org/html/2609.19827#bib.bib15)\. They primarily focus on well\-bounded static scenarios such as general QA and elementary math reasoning, which differ from the ambiguous, multi\-dimensional user intents in real DeepSearch applications\.

To address these limitations, we proposeF2DR, a fine\-grained full\-pipeline reward framework for evaluating DeepSearch workflows\. F2DR performs a comprehensive assessment across three dimensions:Contentdimension assesses the semantic coverage and factual grounding of retrieved information against core knowledge points, utilizing fine\-grained checklists to verify factual and data consistency;Trajectorydimension evaluates multi\-turn reasoning and task decomposition through six rigorous sub\-dimensions, including intent understanding, search atomicity, planning consistency, gap resolution, planning comprehensiveness, and iterative innovation, while penalizing redundant reasoning and ensuring alignment between planning and execution;Answerdimension combines subjective criteria, such as intent matching, logical coherence, and conciseness, with objective metrics measuring core information coverage, thereby ensuring both factual completeness and logical rigor in final responses\. With these three dimensions, F2DR delivers holistic and process\-level evaluation for DeepSearch workflows\.

Built upon F2DR, we further constructDeepSearch RM\-Bench, a dedicated benchmark for reward model evaluation in full\-pipeline DeepSearch scenarios\. Specifically, during data construction, we adopt a “planning\-reflection – information acquisition – answer generation” workflow\. In the planning\-reflection phase, the system uses a Directed Acyclic Graph \(DAG\) to decompose queries into atomic sub\-tasks and dynamically adjusts search strategies via metacognitive reflection on evidence sufficiency\. During information\-acquisition phase, it executes the DAG by integrating search engines and Model Context Protocol \(MCP\) tools to gather multi\-source data, ensuring retrieval breadth and depth\. Finally, in the answer generation phase, it aggregates cross\-turn evidence for fact verification and conflict resolution, optimizing the reasoning chain to produce a high\-quality structured response\. To maintain an appropriate level of evaluation difficulty, we filtered out preference pairs with excessively high or low score variances and conduct secondary human verification to ensure sufficient discriminability across both planning trajectories and final responses for identical queries\. Extensive experiments demonstrate that F2DR provides substantially more consistent and reliable evaluations than self\-evaluation\-based baselines\. Furthermore, mainstream open\-source RMs exhibit significant performance bottlenecks on DeepSearch RM\-Bench, indicating the substantial difficulty and discriminative capability of our benchmark\.

In summary, our contributions are as follows:

- •We propose F2DR, a process\-level reward framework tailored for complex real\-world DeepSearch workflows, covering three complementary dimensions: Content, Trajectory, and Answer\.
- •We develop DeepSearch RM\-Bench, a high\-quality benchmark dedicated to assessing RMs in full\-pipeline DeepSearch scenarios\.
- •Through extensive experiments, we demonstrate that F2DR achieves substantially higher evaluation consistency, while current state\-of\-the\-art reward models still exhibit considerable limitations on DeepSearch RM\-Bench\.

![Refer to caption](https://arxiv.org/html/2609.19827v1/fig_1.png)Figure 1:Full\-pipeline overview of DeepSearch RM\-Bench based on F2DR, consisting of three phases: \(1\) Data Collection: generating full\-pipeline DeepSearch trajectories by LLMs equipped with search tools; \(2\) DeepSearch RM\-Bench Construction: conducting fine\-grained full\-pipeline evaluation through the F2DR framework, followed by filtering and human verification to construct DeepSearch RM\-Bench; \(3\) Evaluation: benchmarking RMs performance and validating F2DR superiority\.
## 2Related Work

DeepSearch\.DeepSearch integrates the reasoning capabilities of LLMs with search engines and tool invocations to construct an iterative workflow, comprising “planning\-reflection, information retrieval, and answer generation”, to address complex tasks in real\-world scenarios\. Current optimization strategies predominantly focus on workflow\-based prompt engineering\([Li et al\., 2025c](https://arxiv.org/html/2609.19827#bib.bib38)\), supervised fine\-tuning\([Wu et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib16)\), and end\-to\-end reinforcement learning for autonomous agents\([Li et al\., 2025b](https://arxiv.org/html/2609.19827#bib.bib17);[Dong et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib18);[Mei et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib19);[Nguyen et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib20);[Yao et al\., 2026](https://arxiv.org/html/2609.19827#bib.bib21)\)\. However, existing research lacks a specialized evaluation workflow for DeepSearch; current assessments largely rely on general LLM\-as\-a\-judge approaches, which are often ill\-equipped to conduct granular assessments of the complex issues within DeepSearch scenarios\.

RMs and RM Benchmarks\.Existing RMs can be categorized into two paradigms\. Discriminative RMs\([Wang et al\., 2024b](https://arxiv.org/html/2609.19827#bib.bib22);[Yuan et al\., 2024](https://arxiv.org/html/2609.19827#bib.bib23)\), typically built upon the Bradley\-Terry \(BT\) framework, represent relative preferences by outputting scalar scores for response pairs\. However, such methods provide limited interpretability and lack explicit reasoning processes\. While generative RMs\([Guo et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib24);[Wang et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib25)\)can formulate scoring principles, they often suffer from poor adaptability to specific contexts and are prone to factual hallucinations\. In terms of benchmarking, existing RM benchmarks\([Zhou et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib26);[Tan et al\., 2024](https://arxiv.org/html/2609.19827#bib.bib27)\)focus on static scenarios, such as mathematics and general question\-answering\. They fail to adequately cover the complex decision\-making trajectories and dynamic interactions inherent in real\-world DeepSearch workflows\.

## 3Methodology

We first filter and construct high\-quality DeepSearch query datasets\. Then we propose F2DR, a fine\-grained full\-pipeline framework for evaluating DeepSearch\. Based on real\-world industrial search data, we further construct DeepSearch RM\-Bench by annotating each stage of workflow with F2DR\. Figure[1](https://arxiv.org/html/2609.19827#S1.F1)illustrates the construction process of DeepSearch RM\-Bench with F2DR\.

### 3\.1DeepSearch Data Collection

Our DeepSearch query is drawn from a large\-scale enterprise search platform\. To select high\-quality queries from massive user logs, we employ a dual\-stage filtering mechanism\. First, we extract raw user queries explicitly invoking "deep thinking", then utilize DeepSeek\-V3\([DeepSeek\-AI, 2024](https://arxiv.org/html/2609.19827#bib.bib28)\)to filter out trivial or single\-hop queries, retaining only those that require complex, multi\-hop reasoning\.

For these retained complex queries, we replicate the full industrial DeepSearch execution pipeline to generate diverse reasoning trajectories and final responses\. DeepSearch addresses such knowledge\-intensive tasks through an iterative closed\-loop workflow of planning\-reflection, information retrieval, and answer generation\. To handle these queries effectively, we adopt a Directed Acyclic Graph \(DAG\)\-based planning\-reflection paradigm, departing from the linear chain\-based approaches used in prior work such as Search\-R1\([Jin et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib33);[Chen et al\., 2025b](https://arxiv.org/html/2609.19827#bib.bib34);[Song et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib35);[Leng et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib30);[Xiong et al\., 2025](https://arxiv.org/html/2609.19827#bib.bib29)\)\. Unlike linear paradigms that rely on strictly sequential iterations, the DAG structure models reasoning as a graph: each node represents an atomic sub\-goal involving search APIs or MCP tool calls, and directed edges explicitly encode dependencies between sub\-tasks\. Retrieval results from completed sub\-goals directly inform subsequent planning steps, enabling continuous re\-planning and real\-time DAG updates\. This globally coordinated task decomposition and dynamic dependency tracking enable our workflow to construct rigorous execution trajectories for multi\-hop problems, effectively identifying and bridging information gaps across all planning stages\.

In the final response stage, we synthesize the information retrieved across multiple turns into a response with logical coherence and factual completeness\. To construct high\-quality preference data, we employ DeepSeek\-V3 and Qwen\-Next\-80B\-A3B as LLMs within the DeepSearch workflow\. Their distinct reasoning trajectories and retrieval behaviors yield diverse outputs for identical queries, forming reliable preference pairs for reward model evaluation\. A detailed case study of the workflow is provided in Appendix[A](https://arxiv.org/html/2609.19827#A1)\.

### 3\.2F2DR

To facilitate automated evaluation and defect identification for DeepSearch workflows, we design a fine\-grained full\-pipeline reward framework comprising Content, Trajectory, and Answer dimensions\. These dimensions enable comprehensive assessment across the entire DeepSearch workflow, including planning\-reflection, information retrieval, and answer generation\. Detailed prompts are provided in Appendix[B](https://arxiv.org/html/2609.19827#A2)\.

#### Content\.

This dimension evaluates the semantic coverage and factual grounding of retrieved information against knowledge points\. Specifically, we aggregate responses from frontier models \(e\.g\., Gemini111[https://gemini\.google\.com/app](https://gemini.google.com/app), Doubao222[https://www\.doubao\.com/chat/](https://www.doubao.com/chat/), and Qwen333[https://qwen\.ai/home/](https://qwen.ai/home/)\) operating in web\-search environments to obtain high\-confidence, multi\-source reference answers\. Then, DeepSeek\-R1\([DeepSeek\-AI, 2025](https://arxiv.org/html/2609.19827#bib.bib32)\)is utilized to summarize and decompose these results into atomic knowledge points defined as\(Entity, Attribute/State\)pairs\. These units are further categorized into core and auxiliary knowledge points, forming a checklist for fine\-grained verification\. Evaluation is subsequently performed by measuring both the semantic coverage and factual consistency of retrieved evidence against this knowledge inventory\.

#### Trajectory\.

This dimension performs hierarchical logical auditing of the dynamic reasoning process during the planning\-reflection phase, ensuring the rigor of the entire reasoning pipeline at both the task and trajectory levels\. We conduct in\-depth analysis on execution logs and identify common flaws in DeepSearch reasoning chains, including mixed search keywords, disjointed planning and DAG execution, and repetitive operations\. We refine these defects and categorize them into task\-level and trajectory\-level evaluation dimensions\. At the task level, we evaluate the rationality of individual subtasks through three core metrics: intent understanding correct, which verifies the model’s accuracy in recognizing both explicit user needs and implicit constraints; search task atomicity, which verifies the compliance of each search task as a semantically independent minimal unit to prevent cross\-topic mixed searches; and reasoning\-planning consistency, which verifies the alignment between information gaps identified during reasoning and corresponding concrete search tasks\. At the trajectory level, guided by the core principle of continuous information entropy reduction, meaning each search round effectively reduces uncertainty, we assess the overall quality of the entire multi\-turn reasoning chain through three core metrics: gap resolution degree, which quantifies the proportion of identified information gaps that have been filled; planning comprehensiveness, which verifies the completeness of the plan in covering all information dimensions required to answer the query; and reasoning iterative innovation, which evaluates the ability of each search round to bring new incremental information, thereby avoiding meaningless repetitive exploration\. This hierarchical evaluation scheme enables precise localization of specific defects within the planning\-reflection pipeline\.

#### Answer\.

This dimension integrates subjective qualitative assessment with checklist\-based objective quantitative metrics\. Subjectively, we evaluate intent alignment, logical coherence, and response conciseness\. Objectively, we quantify answer completeness by measuring the coverage rate of core knowledge points from the pre\-defined checklist\. This hybrid approach enables a robust evaluation of the final response\.

Based on DeepSearch ablation experiments, the following weights yield optimal performance \(Table[16](https://arxiv.org/html/2609.19827#A6.T16)\)\. The final reward score is:

Scorefinal=0\.75⋅Scorecontent\+Scoretrajectory\+1\.25⋅Scoreanswer\\begin\{split\}\\text\{Score\}\_\{\\text\{final\}\}&=0\.75\\cdot\\text\{Score\}\_\{\\text\{content\}\}\+\\text\{Score\}\_\{\\text\{trajectory\}\}\\\\ &\\quad\+1\.25\\cdot\\text\{Score\}\_\{\\text\{answer\}\}\\end\{split\}
DimensionSub\-dimensionConsistencyContentChecklist Coverage Rate0\.9303TrajectoryIntent Understanding Correctness0\.9662Search Task Atomicity0\.9114Reasoning\-Planning Consistency0\.9485Gap Resolution Degree0\.9627Planning Comprehensiveness0\.9301Reasoning Iteration Innovation0\.9573AnswerDemand Understanding0\.9542Content Quality0\.9402Answer Coverage Rate0\.9293Table 1:Human consistency results across different evaluation dimensions\.

### 3\.3DeepSearch RM\-Bench Construction

#### Data Filtering\.

We propose a preference data filtering strategy that integrates multi\-model consensus and collaborative expert verification to construct DeepSearch RM\-Bench with high discriminability and appropriate difficulty\. It is important to distinguish two levels of filtering\. At the query level, we remove only trivial and single\-hop queries and retain every question that requires multi\-hop reasoning, so no hard question is dropped at this stage\. At the preference\-pair level, advanced reasoning models, including DeepSeek\-R1, Doubao\-Seed\-1\.6\-Thinking, and Qwen\-3\-235B\-A22B\-Thinking, independently score each sample multiple times, with preference polarity determined via majority voting to mitigate model family bias\. To balance discriminability and task difficulty, we then filter out pairs with excessively large or small score gaps: a too\-large gap indicates that one response is clearly better and hence too easy, while a too\-small gap is what we refer to as ambiguous—note that this term describes preference pairs, not the queries themselves\. For these small\-gap ambiguous pairs, we further conducted a round of manual re\-review and found that they are difficult to distinguish not only for the LLMs but also for our human annotators, who likewise could not clearly tell which of the two responses was better; in other words, they are genuine ties, and we remove them because the preference direction itself is unreliable and retaining them would only introduce noise\. The score gaps of the retained pairs are generally not large \(with an average gap of about 0\.2774\), which indicates that we intentionally keep a substantial number of closely matched, challenging pairs\. We prioritize samples with balanced performance across Content, Trajectory, and Answer dimensions, ensuring logical consistency across planning, reasoning, and final answers\.

Figure 2:Task\(Inner\) and Domain\(Outer\) Distribution of the DeepSearch RM\-bench\.
#### Manually Verification\.

Systematically trained internal annotators manually verify the automatically generated checklists and model scoring rationales according to F2DR guidelines, while filtering out invalid cases caused by retrieval failures from search engines\. We evaluate inter\-annotator agreement using Fleiss’ Kappa coefficient\. The coefficients across all dimensions exceed 0\.9, indicating almost perfect consistency among annotators\. Such high consistency is attributed to the annotators’ domain expertise and rigorous training procedures, alongside comprehensive annotation guidelines that explicitly define evaluation criteria and edge cases\. Table[1](https://arxiv.org/html/2609.19827#S3.T1)summarizes the agreement statistics across the Content, Trajectory, and Answer dimensions\.

#### Quality Evaluation\.

Through the multi\-stage filtering pipeline, we obtain a candidate pool of preference pairs\. Since the F2DR framework is used to filter this data, relying on it again for evaluation would create a self\-confirmation loop—essentially allowing the system to act as both player and referee, inherently assigning artificially high scores to its own selections\. To break this loop and objectively validate the dataset quality, we introduce an independent, human\-led industrial AI search evaluation system as a third\-party benchmark\. This evaluation system employs a five\-dimensional scoring scheme: intent comprehension, factual accuracy, information utility, professionalism, and contextual relevance\. Five domain experts in deepsearch conducted a blind review of the candidate pairs\. Detailed information on annotators can be found in Appendix[G](https://arxiv.org/html/2609.19827#A7)\. Specifically designed to evaluate the validity of preference pairs, the assessment follows the standard Side\-by\-Side protocol using Good\-Same\-Bad \(GSB\) logic: a preference pair is labeledGoodif the chosen response outperforms the rejected one,Sameif their quality is indistinguishable, andBadif the chosen response is inferior\. The detailed design and full results of this GSB evaluation are provided in Appendix[E](https://arxiv.org/html/2609.19827#A5)\.

Path TypePlanningRoundsSearchCountsTokens\(Plan\)Tokens\(Ans\)Chosen Path3\.6361\.5622890\.561136\.83Rejected Path3\.4551\.5918838\.64951\.60Table 2:Comparison of execution statistics between Chosen and Rejected paths\.ModelSelf\-evaluationF2DRModelpreference accuracyGPT\-558\.9769\.25Skywork\-Reward\-V2\-Llama\-3\.2\-1B51\.31Claude 4\.5 Sonnet59\.6268\.87Skywork\-Reward\-V2\-Qwen3\-1\.7B50\.65doubao\-Seed\-1\.858\.4170\.56Skywork\-Reward\-V2\-Llama\-3\.2\-3B52\.24DeepSeek\-R170\.0085\.79Skywork\-Reward\-V2\-Qwen3\-4B56\.26DeepSeek\-V4\-Pro62\.9071\.77Skywork\-Reward\-Llama\-3\.1\-8B\-v0\.259\.25DeepSeek\-V359\.7166\.82Skywork\-Reward\-V2\-Qwen3\-8B56\.16GLM\-562\.6170\.93Skywork\-Reward\-Gemma\-2\-27B\-v0\.261\.03Qwen\-Max63\.6472\.61internlm2\-1\_8b\-reward48\.87Qwen3\-235B\-A22B\-Thinking63\.5574\.95Internlm2\-7b\-reward53\.55Qwen3\-235B\-A22B60\.0968\.87Internlm2\-20b\-reward57\.47Qwen3\-30B\-A3B57\.6665\.51ArmoRM\-Llama3\-8B\-v0\.149\.43Qwen3\-32B58\.3164\.20Llama\-3\.1\-Nemotron\-70B\-Reward57\.94Qwen3\-14B50\.2857\.94DeepSeek\-GRM\-16B61\.58Qwen3\-8B48\.9757\.66DeepSeek\-GRM\-27B63\.18Llama\-3\.3\-70B\-Instruct53\.6459\.91RM\-R1\-Qwen2\.5\-Instruct\-7B60\.74Llama\-3\.1\-8B\-Instruct47\.0156\.91RM\-R1\-Qwen2\.5\-Instruct\-32B62\.99

Table 3:Main Results\.Comparison between model self\-evaluation and ourF2DRpreference scores \(left\), and the performance of other RMs on theDeepSearch RM\-bench\(right\)\.
#### Overall Statistics\.

DeepSearch RM\-Bench consists of 1,070 preference pairs built over 1,070 unique queries \(one pair per query\), covering both English and Chinese\. We evaluate the benchmark across three perspectives—task taxonomy, domain distribution, and execution preference—to assess its quality, diversity, and representativeness\. We categorize its queries into six task types, ranging from factual retrieval to complex Decision Making\. As shown in Figure[2](https://arxiv.org/html/2609.19827#S3.F2),Domain Knowledgeforms the largest proportion \(45\.98%\), serving as the primary scenario requiring advanced information synthesis\. The benchmark additionally includes General Knowledge, How To guides, Advisory Service, and Subjective Views tasks\. It covers 10 vertical domains, with knowledge\-intensive sectors \(e\.g\., Science Technology, Finance Economics, Medical Health, Government Law\) comprising over 57%\. For query length, we measure Chinese text by characters and English text by words: Chinese queries range from 6 to 286 characters \(median 23, mean 31\.5\), while English queries range from 6 to 85 words \(median 12, mean 16\.4\), and on average one English word corresponds to approximately 1\.92 Chinese characters\. The overall length distribution is right\-skewed—38\.0% of queries are short \(6–19 characters\), 42\.4% are medium \(20–39 characters\), and 19\.5% are long \(40–286 characters\)—with roughly 80% of queries falling between 6 and 40 characters and a small long tail of complex multi\-hop questions extending up to 286 characters\. Table[2](https://arxiv.org/html/2609.19827#S3.T2)compares execution statistics: chosen trajectories exhibit higher complexity and information density than rejected ones, featuring more planning iterations, frequent retrievals, and longer responses, which indicates that preference signals in DeepSearch are driven by reasoning depth and comprehensive evidence synthesis\.

## 4Experiment

### 4\.1Main Results

Our core evaluation metric ispreference accuracy, defined as the proportion of samples where the model correctly assigns a higher preference score to the human\-annotatedchosentrajectory than to therejectedtrajectory\. As shown in Table[3](https://arxiv.org/html/2609.19827#S3.T3), we first compare the performance of our F2DR framework against the vanilla self\-evaluation method\. In the self\-evaluation setting, models directly assign a holistic scalar score to the entire DeepSearch workflow, with the specific evaluation prompt detailed in Table[14](https://arxiv.org/html/2609.19827#A4.T14)\. This unconstrained scoring paradigm lacks structured dimensional decomposition and process\-level auditing, fundamentally hindering the models’ ability to grasp the critical evaluation dimensions specific to DeepSearch scenarios\.

Under the F2DR framework, models successfully overcome these limitations through structured, dimension\-wise constraints, achieving a significant leap in effectiveness\. On average, F2DR yields a 10\-percentage\-point improvement in preference accuracy, precisely identifying subtle logical inconsistencies and process\-level defects that self\-evaluation frequently overlooks\. The substantial and uniform gains achieved across all frontier models suggest that the primary bottleneck for DeepSearch evaluation lies not in the foundational knowledge capacity of large models, but in the lack of structured guidance and standardized process\-level evaluation mechanisms for complex multi\-step workflows\.

![Refer to caption](https://arxiv.org/html/2609.19827v1/fig_3.png)Figure 3:Pearson Correlation Coefficients of Evaluation Dimensions: Model vs\. Human Evaluation under the Unified F2DR Framework\.Notably, reasoning\-centric models exhibit a decisive advantage over traditional foundational models in this complex evaluation task\. DeepSeek\-R1 not only achieves the highest absolute preference score of 85\.79 but also shows the most pronounced improvement of 15\.79 points under the F2DR framework\. This significantly outperforms traditional closed\-source models like GPT\-5 and Claude 4\.5 Sonnet, which achieve scores of 69\.25 and 68\.87 respectively\. Similarly, Qwen3\-235B\-A22B\-Thinking achieves a preference score of 74\.95, outperforming its standard counterpart Qwen3\-235B\-A22B at 68\.87 by 6\.08 points\. These results highlight that F2DR effectively unlocks the potential of reasoning models by prompting them to precisely map retrieved information to atomic knowledge at the content level, make metacognitive judgments on planning and reflection for the search trajectory, and execute rigorous consistency checks on the final answer\. Furthermore, even the lightweight Qwen3\-8B achieves a preference score of 57\.66 under F2DR, closely approaching the vanilla self\-evaluation performance of several top\-tier closed\-source models\. This demonstrates that rigorous, full\-pipeline evaluation constraints can effectively compensate for parameter scale limitations to ensure robust evaluation quality\.

Comparisons with open\-source reward models \(RMs\) highlight the limitations of traditional RM paradigms\. Bradley\-Terry discriminative models \(e\.g\., Internlm2\-7b\-reward: 48\.87, ArmoRM\-Llama3\-8B\-v0\.1: 49\.43\) perform poorly, as compressing dynamic, dense DeepSearch trajectories into a single scalar score incurs severe information entropy loss\. Although generative reasoning\-enhanced models \(e\.g\., RM\-R1\-Qwen2\.5\-Instruct\-32B: 62\.99, DeepSeek\-GRM\-27B: 63\.18\) achieve stronger performance via reasoning mechanisms, they evaluate the final answers, neglecting intermediate planning or reflection processes\.

ModelsF2DRw/o Contentw/o Trajectoryw/o AnswerGPT\-569\.2567\.9464\.9565\.98Claude 4\.5 Sonnet68\.8762\.2467\.9461\.03doubao\-Seed\-1\.870\.5667\.3869\.5365\.51DeepSeek\-R185\.7980\.2878\.4181\.30DeepSeek\-V4\-Pro71\.7770\.9369\.3467\.01DeepSeek\-V366\.8260\.0064\.5762\.42GLM\-570\.9367\.1969\.8770\.37Qwen\-Max72\.6169\.0767\.3870\.84Qwen3\-235B\-A22B\-Thinking74\.9573\.4570\.1870\.84Qwen3\-235B\-A22B68\.8764\.5766\.0763\.17Qwen3\-30B\-A3B65\.5162\.1764\.5864\.85Qwen3\-32B64\.2063\.9261\.0258\.97Qwen3\-14B57\.9457\.0156\.3654\.20Qwen3\-8B57\.6654\.9557\.1954\.95Llama\-3\.3\-70B\-Instruct59\.9155\.4256\.1656\.82Llama\-3\.1\-8B\-Instruct56\.9153\.4555\.1455\.38Table 4:Ablation results of F2DR framework across different models\.Figure 4:Performance of various models across task and domain dimensions on the DeepSearch RM\-bench\.
### 4\.2Ablation Study

As shown in Table[4](https://arxiv.org/html/2609.19827#S4.T4), ablation studies validate the independent contributions of the F2DR framework’s three dimensions: removing any single dimension systematically degrades performance across all models, confirming their complementarity\. Model architectures exhibit distinct sensitivities to these dimensions\. Thinking models with explicit reasoning are most affected by the trajectory dimension \(missing this dimension causes DeepSeek\-R1 to drop by 7\.38 points and Qwen3\-235B\-A22B\-Thinking by 4\.77 points\), underscoring the necessity of process\-level evaluation\. Conversely, non\-Thinking models rely heavily on the answer dimension \(Claude 4\.5 Sonnet drops by 7\.84 points\), revealing their inability to effectively evaluate the trajectory dimension\. Furthermore, the content relevance dimension provides a stable, foundational contribution, as its removal consistently leads to varying degrees of performance degradation across all models\. Overall, F2DR bridges outcome quality and reasoning process evaluation, establishing a fairer, more comprehensive standard for assessing DeepSearch capabilities across diverse model architectures\.

### 4\.3Analysis of Evaluation Dimensions

We further measured the consistency between model judgments and annotated evaluation dimensions using the Pearson correlation coefficient\. Detailed results are shown in Figure[3](https://arxiv.org/html/2609.19827#S4.F3)\. Notably, Thinking\-series models with enhanced reasoning capabilities generally exhibit more prominent consistency across all dimensions, demonstrating stronger alignment with the F2DR criteria\. From a dimension perspective, the Content and Answer dimensions exhibited relatively high consistency scores\. This is mainly due to their intuitive evaluation logic and reliance on quantifiable checklist\-based objective verification, enabling models to reliably capture the core characteristics of evaluation criteria\. In contrast, the Trajectory dimension generally exhibits lower consistency\. This limitation mainly stems from the models’ insufficient understanding of subjective evaluation signals, as well as the difficulty of accurately identifying and localizing defects within the planning\-reflection process\.

ModelChosen AvgRejected AvgGPT\-50\.59020\.5034Claude 4\.5 Sonnet0\.28100\.2363doubao\-Seed\-1\.80\.97330\.9374DeepSeek\-R10\.89340\.8123DeepSeek\-V4\-Pro0\.93340\.8931DeepSeek\-V30\.96830\.9607GLM\-50\.95040\.9003Qwen\-Max0\.93510\.8455Qwen3\-235B\-A22B\-Thinking0\.83710\.6928Qwen3\-235B\-A22B0\.93440\.9029Qwen3\-30B\-A3B0\.95610\.9415Qwen3\-32B0\.93090\.9012Qwen3\-14B0\.95430\.9398Qwen3\-8B0\.98450\.9552Llama\-3\.3\-70B\-Instruct0\.88980\.7523Llama\-3\.1\-8B\-Instruct0\.84230\.7752

Table 5:Average Scores on Chosen and Rejected Trajectory Dimensions\.
### 4\.4Analysis of Trajectory Evaluation

In our fine\-grained Trajectory dimension analysis, we evaluated model scores against the human\-annotated ground truth\. As shown in Table[5](https://arxiv.org/html/2609.19827#S4.T5), Thinking\-series models demonstrate superior discrimination\. Notably, Qwen3\-235B\-A22B\-Thinking and DeepSeek\-R1 stand out with score gaps of 0\.1443 and 0\.0811, respectively, effectively identifying specific flaws like keyword redundancy and unstructured reasoning within the planning and reflection loop\. Several non\-Thinking\-series models also show competitive evaluation capabilities, including Qwen\-Max \(0\.0896 gap\), GLM\-5 \(0\.0501\), and DeepSeek\-V4\-Pro \(0\.0403\)\. Conversely, DeepSeek\-V3, Qwen3\-8B, and Doubao\-Seed\-1\.8 consistently score near 1\.0 across all trajectories; this negligible gap reveals severe calibration issues and an inability to differentiate planning quality\. Furthermore, GPT\-5 and Claude 4\.5 Sonnet score very low, also with marginal gaps, suggesting a general inability among most large closed\-source models to reliably evaluate complex DeepSearch trajectories\.

### 4\.5Analysis of Query Type

We systematically evaluated mainstream LLMs across six general dimensions and ten industrial domains, revealing a distinct performance stratification\. The results are illustrated in Figure[4](https://arxiv.org/html/2609.19827#S4.F4)\. DeepSeek\-R1 maintains a lead across all evaluated metrics, attributed to its superior reasoning capabilities\. In contrast, the performance of other models aligns with the scaling law, where evaluative proficiency improves with increasing parameter scale\. The domain\-level analysis reveals that models exhibit high evaluative consistency in daily scenarios such as Work HR and Travel Transport\. This proficiency stems from the high data density and standardized logic in pre\-training corpora, allowing for precise pattern matching\. However, significant performance degradation occurs in high\-threshold domains like Medical Health and Science Technology, indicating that general\-purpose capabilities remain insufficient to bridge the gap toward specialist\-level cognition\. The How To \(or procedural knowledge\) dimension represents a universal evaluative bottleneck\. Models are proficient in declarative descriptions focused on what to say but struggle with procedural logic pertaining to how to act\. Lacking a grounded understanding of causality and temporal sequences, they tend to judge quality based on linguistic probability rather than identifying latent logical breaks in execution steps\.

## 5Conclusion

To address the critical absence of process\-level evaluation for DeepSearch scenarios, we present F2DR and DeepSearch RM\-Bench\. F2DR assesses the entire DeepSearch workflow across three complementary fine\-grained dimensions: Content, Trajectory, and Answer\. Built upon this framework, DeepSearch RM\-Bench is the first dedicated benchmark for evaluating reward models in full\-pipeline DeepSearch scenarios, comprising high\-quality preference pairs annotated with rigorous process\-level labels\. Experimental results show that F2DR significantly outperforms existing baselines in evaluation consistency\. Furthermore, DeepSearch RM\-Bench poses significant challenges to mainstream open\-source reward models, revealing their fundamental performance bottlenecks in complex multi\-step decision\-making chains\.

## Acknowledgments

The present research was supported by the National Key Research and Development Program of China \(Grant No\. 2024YFE0203000\), the China Postdoctoral Science Foundation \(Grant No\. 2026M791664\) and the Postdoctoral Fellowship Program of CPSF \(Grant No\. GZC20251075\)\. We would like to thank the anonymous reviewers for their insightful comments\.

## Limitation

While current evaluations depend on API calls, optimizing the performance\-efficiency trade\-off is our next step\. By training a dedicated DeepSearch RM using fine\-grained F2DR signals as supervision, we can substantially lower resource costs without compromising complex search logic modeling\.

## References

- Caiet al\.\(2024\)Z\. Cai, M\. Cao, H\. Chen, K\. Chen, K\. Chen, X\. Chen, X\. Chen, Z\. Chen, Z\. Chen, P\. Chu, X\. Dong, H\. Duan, Q\. Fan, Z\. Fei, Y\. Gao, J\. Ge, C\. Gu, Y\. Gu, and T\. GuiInternLM2 technical report\.CoRRabs/2403\.17297\.External Links:[Link](https://doi.org/10.48550/arXiv.2403.17297),[Document](https://dx.doi.org/10.48550/ARXIV.2403.17297),2403\.17297Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Chenet al\.\(2025a\)G\. Chen, Z\. Qiao, X\. Chen, D\. Yu, H\. Xu, W\. X\. Zhao, R\. Song, W\. Yin, H\. Yin, L\. Zhang, K\. Li, M\. Liao, Y\. Jiang, P\. Xie, F\. Huang, and J\. ZhouIterResearch: rethinking long\-horizon agents via markovian state reconstruction\.CoRRabs/2511\.07327\.External Links:[Link](https://doi.org/10.48550/arXiv.2511.07327),[Document](https://dx.doi.org/10.48550/ARXIV.2511.07327),2511\.07327Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p1.1)\.
- Chenet al\.\(2025b\)M\. Chen, T\. Li, H\. Sun, Y\. Zhou, C\. Zhu, H\. Wang, J\. Z\. Pan, W\. Zhang, H\. Chen, F\. Yang, Z\. Zhou, and W\. ChenReSearch: learning to reason with search for llms via reinforcement learning\.CoRRabs/2503\.19470\.External Links:[Link](https://doi.org/10.48550/arXiv.2503.19470),[Document](https://dx.doi.org/10.48550/ARXIV.2503.19470),2503\.19470Cited by:[§3\.1](https://arxiv.org/html/2609.19827#S3.SS1.p2.1)\.
- Chenet al\.\(2025c\)X\. Chen, G\. Li, Z\. Wang, B\. Jin, C\. Qian, Y\. Wang, H\. Wang, Y\. Zhang, D\. Zhang, T\. Zhang, H\. Tong, and H\. JiRM\-R1: reward modeling as reasoning\.CoRRabs/2505\.02387\.External Links:[Link](https://doi.org/10.48550/arXiv.2505.02387),[Document](https://dx.doi.org/10.48550/ARXIV.2505.02387),2505\.02387Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- DeepSeek\-AI \(2024\)DeepSeek\-AIDeepSeek\-v3 technical report\.CoRRabs/2412\.19437\.External Links:[Link](https://doi.org/10.48550/arXiv.2412.19437),[Document](https://dx.doi.org/10.48550/ARXIV.2412.19437),2412\.19437Cited by:[§3\.1](https://arxiv.org/html/2609.19827#S3.SS1.p1.1)\.
- DeepSeek\-AI \(2025\)DeepSeek\-AIDeepSeek\-r1: incentivizing reasoning capability in llms via reinforcement learning\.CoRRabs/2501\.12948\.External Links:[Link](https://doi.org/10.48550/arXiv.2501.12948),[Document](https://dx.doi.org/10.48550/ARXIV.2501.12948),2501\.12948Cited by:[§3\.2](https://arxiv.org/html/2609.19827#S3.SS2.SSS0.Px1.p1.1)\.
- Denget al\.\(2025\)Y\. Deng, G\. Wang, Z\. Ying, X\. Wu, J\. Lin, W\. Xiong, Y\. Dai, S\. Yang, Z\. Zhang, Q\. Wang, Y\. Qin, Y\. Wang, Q\. Zha, S\. Dai, and C\. MengAtom\-searcher: enhancing agentic deep research via fine\-grained atomic thought reward\.CoRRabs/2508\.12800\.External Links:[Link](https://doi.org/10.48550/arXiv.2508.12800),[Document](https://dx.doi.org/10.48550/ARXIV.2508.12800),2508\.12800Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p1.1)\.
- Donget al\.\(2025\)G\. Dong, H\. Mao, K\. Ma, L\. Bao, Y\. Chen, Z\. Wang, Z\. Chen, J\. Du, H\. Wang, F\. Zhang, G\. Zhou, Y\. Zhu, J\. Wen, and Z\. DouAgentic reinforced policy optimization\.CoRRabs/2507\.19849\.External Links:[Link](https://doi.org/10.48550/arXiv.2507.19849),[Document](https://dx.doi.org/10.48550/ARXIV.2507.19849),2507\.19849Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Guoet al\.\(2025\)J\. Guo, Z\. Chi, L\. Dong, Q\. Dong, X\. Wu, S\. Huang, and F\. WeiReward reasoning model\.CoRRabs/2505\.14674\.External Links:[Link](https://doi.org/10.48550/arXiv.2505.14674),[Document](https://dx.doi.org/10.48550/ARXIV.2505.14674),2505\.14674Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p2.1)\.
- Haaset al\.\(2025\)L\. Haas, G\. Yona, G\. D’Antonio, S\. Goldshtein, and D\. DasSimpleQA verified: A reliable factuality benchmark to measure parametric knowledge\.CoRRabs/2509\.07968\.External Links:[Link](https://doi.org/10.48550/arXiv.2509.07968),[Document](https://dx.doi.org/10.48550/ARXIV.2509.07968),2509\.07968Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p1.1)\.
- Jinet al\.\(2025\)B\. Jin, H\. Zeng, Z\. Yue, D\. Wang, H\. Zamani, and J\. HanSearch\-r1: training llms to reason and leverage search engines with reinforcement learning\.CoRRabs/2503\.09516\.External Links:[Link](https://doi.org/10.48550/arXiv.2503.09516),[Document](https://dx.doi.org/10.48550/ARXIV.2503.09516),2503\.09516Cited by:[§3\.1](https://arxiv.org/html/2609.19827#S3.SS1.p2.1)\.
- Lambertet al\.\(2024\)N\. Lambert, V\. Pyatkin, J\. Morrison, L\. Miranda, B\. Y\. Lin, K\. R\. Chandu, N\. Dziri, S\. Kumar, T\. Zick, Y\. Choi, N\. A\. Smith, and H\. HajishirziRewardBench: evaluating reward models for language modeling\.CoRRabs/2403\.13787\.External Links:[Link](https://doi.org/10.48550/arXiv.2403.13787),[Document](https://dx.doi.org/10.48550/ARXIV.2403.13787),2403\.13787Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Lenget al\.\(2025\)Y\. Leng, Y\. Lei, X\. Liu, M\. Zhong, B\. Xiong, Y\. Zhang, Y\. Gao, Y\. Wu, Y\. Hu, and D\. XiongDecEx\-rag: boosting agentic retrieval\-augmented generation with decision and execution optimization via process supervision\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, EMNLP 2025 \- Industry Track, Suzhou, China, November 4\-9, 2025,S\. Potdar, L\. M\. Rojas\-Barahona, and S\. Montella \(Eds\.\),pp\. 1412–1425\.External Links:[Link](https://doi.org/10.18653/v1/2025.emnlp-industry.99),[Document](https://dx.doi.org/10.18653/V1/2025.EMNLP-INDUSTRY.99)Cited by:[§3\.1](https://arxiv.org/html/2609.19827#S3.SS1.p2.1)\.
- Liet al\.\(2025a\)B\. Li, B\. Zhang, D\. Zhang, F\. Huang, G\. Li, G\. Chen, H\. Yin, J\. Wu, J\. Zhou, K\. Li, L\. Su, L\. Ou, L\. Zhang, P\. Xie, R\. Ye, W\. Yin, X\. Yu, X\. Wang, and X\. WuTongyi deepresearch technical report\.CoRRabs/2510\.24701\.External Links:[Link](https://doi.org/10.48550/arXiv.2510.24701),[Document](https://dx.doi.org/10.48550/ARXIV.2510.24701),2510\.24701Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p1.1)\.
- Liet al\.\(2025b\)W\. Li, J\. Lin, Z\. Jiang, J\. Cao, X\. Liu, J\. Zhang, Z\. Huang, Q\. Chen, W\. Sun, Q\. Wang, H\. Lu, T\. Qin, C\. Zhu, Y\. Yao, S\. Fan, X\. Li, T\. Wang, P\. Liu, and K\. ZhuChain\-of\-agents: end\-to\-end agent foundation models via multi\-agent distillation and agentic RL\.CoRRabs/2508\.13167\.External Links:[Link](https://doi.org/10.48550/arXiv.2508.13167),[Document](https://dx.doi.org/10.48550/ARXIV.2508.13167),2508\.13167Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Liet al\.\(2025c\)X\. Li, G\. Dong, J\. Jin, Y\. Zhang, Y\. Zhou, Y\. Zhu, P\. Zhang, and Z\. DouSearch\-o1: agentic search\-enhanced large reasoning models\.CoRRabs/2501\.05366\.External Links:[Link](https://doi.org/10.48550/arXiv.2501.05366),[Document](https://dx.doi.org/10.48550/ARXIV.2501.05366),2501\.05366Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Lianget al\.\(2026\)Y\. Liang, L\. Liu, L\. Wang, Y\. Wang, Y\. Zhang, L\. Xia, Z\. Sun, and D\. ShiConsistRM: improving generative reward models via consistency\-aware self\-training\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\), ACL 2026, San Diego, California, United States, July 2\-7, 2026,M\. Liakata, V\. P\. Moreira, J\. Zhang, and D\. Jurgens \(Eds\.\),pp\. 39449–39466\.External Links:[Link](https://doi.org/10.18653/v1/2026.acl-long.1830),[Document](https://dx.doi.org/10.18653/V1/2026.ACL-LONG.1830)Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Liuet al\.\(2024a\)C\. Y\. Liu, L\. Zeng, J\. Liu, R\. Yan, J\. He, C\. Wang, S\. Yan, Y\. Liu, and Y\. ZhouSkywork\-reward: bag of tricks for reward modeling in llms\.CoRRabs/2410\.18451\.External Links:[Link](https://doi.org/10.48550/arXiv.2410.18451),[Document](https://dx.doi.org/10.48550/ARXIV.2410.18451),2410\.18451Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Liuet al\.\(2025a\)C\. Y\. Liu, L\. Zeng, Y\. Xiao, J\. He, J\. Liu, C\. Wang, R\. Yan, W\. Shen, F\. Zhang, J\. Xu, Y\. Liu, and Y\. ZhouSkywork\-reward\-v2: scaling preference data curation via human\-ai synergy\.CoRRabs/2507\.01352\.External Links:[Link](https://doi.org/10.48550/arXiv.2507.01352),[Document](https://dx.doi.org/10.48550/ARXIV.2507.01352),2507\.01352Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Liuet al\.\(2024b\)Y\. Liu, Z\. Yao, R\. Min, Y\. Cao, L\. Hou, and J\. LiRM\-bench: benchmarking reward models of language models with subtlety and style\.CoRRabs/2410\.16184\.External Links:[Link](https://doi.org/10.48550/arXiv.2410.16184),[Document](https://dx.doi.org/10.48550/ARXIV.2410.16184),2410\.16184Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Liuet al\.\(2025b\)Z\. Liu, P\. Wang, R\. Xu, S\. Ma, C\. Ruan, P\. Li, Y\. Liu, and Y\. WuInference\-time scaling for generalist reward modeling\.CoRRabs/2504\.02495\.External Links:[Link](https://doi.org/10.48550/arXiv.2504.02495),[Document](https://dx.doi.org/10.48550/ARXIV.2504.02495),2504\.02495Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Maliket al\.\(2025\)S\. Malik, V\. Pyatkin, S\. Land, J\. Morrison, N\. A\. Smith, H\. Hajishirzi, and N\. LambertRewardBench 2: advancing reward model evaluation\.CoRRabs/2506\.01937\.External Links:[Link](https://doi.org/10.48550/arXiv.2506.01937),[Document](https://dx.doi.org/10.48550/ARXIV.2506.01937),2506\.01937Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Meiet al\.\(2025\)L\. Mei, Z\. Yang, and C\. ChenAI\-searchplanner: modular agentic search via pareto\-optimal multi\-objective reinforcement learning\.CoRRabs/2508\.20368\.External Links:[Link](https://doi.org/10.48550/arXiv.2508.20368),[Document](https://dx.doi.org/10.48550/ARXIV.2508.20368),2508\.20368Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Nguyenet al\.\(2025\)X\. Nguyen, S\. Pandit, R\. G\. Reddy, A\. Xu, S\. Savarese, C\. Xiong, and S\. JotySFR\-deepresearch: towards effective reinforcement learning for autonomously reasoning single agents\.CoRRabs/2509\.06283\.External Links:[Link](https://doi.org/10.48550/arXiv.2509.06283),[Document](https://dx.doi.org/10.48550/ARXIV.2509.06283),2509\.06283Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Qinet al\.\(2026\)K\. Qin, L\. Liu, Y\. Liang, L\. Wang, Y\. Wang, Y\. Zhang, L\. Xia, Z\. Sun, H\. Liu, and D\. ShiReflectRM: boosting generative reward models via self\-reflection within a unified judgment framework\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\), ACL 2026, San Diego, California, United States, July 2\-7, 2026,M\. Liakata, V\. P\. Moreira, J\. Zhang, and D\. Jurgens \(Eds\.\),pp\. 36207–36223\.External Links:[Link](https://doi.org/10.18653/v1/2026.acl-long.1676),[Document](https://dx.doi.org/10.18653/V1/2026.ACL-LONG.1676)Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Songet al\.\(2025\)H\. Song, J\. Jiang, Y\. Min, J\. Chen, Z\. Chen, W\. X\. Zhao, L\. Fang, and J\. WenR1\-searcher: incentivizing the search capability in llms via reinforcement learning\.CoRRabs/2503\.05592\.External Links:[Link](https://doi.org/10.48550/arXiv.2503.05592),[Document](https://dx.doi.org/10.48550/ARXIV.2503.05592),2503\.05592Cited by:[§3\.1](https://arxiv.org/html/2609.19827#S3.SS1.p2.1)\.
- Tanet al\.\(2024\)S\. Tan, S\. Zhuang, K\. Montgomery, W\. Y\. Tang, A\. Cuadron, C\. Wang, R\. A\. Popa, and I\. StoicaJudgeBench: A benchmark for evaluating llm\-based judges\.CoRRabs/2410\.12784\.External Links:[Link](https://doi.org/10.48550/arXiv.2410.12784),[Document](https://dx.doi.org/10.48550/ARXIV.2410.12784),2410\.12784Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p2.1)\.
- Teamet al\.\(2025\)M\. Team, S\. Bai, L\. Bing, C\. Chen, G\. Chen, Y\. Chen, Z\. Chen, Z\. Chen, J\. Dai, X\. Dong, W\. Dou, Y\. Deng, Y\. Fu, J\. Ge, C\. Han, T\. Huang, Z\. Huang, J\. Jiao, S\. Jiang, T\. Jiao, X\. Jian, L\. Lei, R\. Li, R\. Luo, T\. Li, X\. Lin, Z\. Liu, Z\. Li, J\. Ni, Q\. Ren, P\. Sun, S\. Su, C\. Tao, B\. Wang, H\. Wang, H\. Wang, J\. Wang, J\. Wang, J\. Wang, L\. Wang, S\. Wang, W\. Wang, Z\. Wang, J\. Xu, S\. Xing, C\. Yang, H\. Ye, J\. Yu, Y\. Yu, M\. Zhong, T\. Zhao, X\. Zhu, Y\. Zhou, Y\. Zhang, and Z\. ZhuMiroThinker: pushing the performance boundaries of open\-source research agents via model, context, and interactive scaling\.CoRRabs/2511\.11793\.External Links:[Link](https://doi.org/10.48550/arXiv.2511.11793),[Document](https://dx.doi.org/10.48550/ARXIV.2511.11793),2511\.11793Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p1.1)\.
- Wanget al\.\(2025\)C\. Wang, Y\. Mu, H\. Zhou, Y\. Huo, Z\. Zhu, J\. Zeng, M\. Yang, B\. Li, T\. Xiao, X\. Hao, C\. Zhang, F\. Meng, and J\. ZhuGRAM\-r2\{\}^\{\\mbox\{2\}\}: self\-training generative foundation reward models for reward reasoning\.CoRRabs/2509\.02492\.External Links:[Link](https://doi.org/10.48550/arXiv.2509.02492),[Document](https://dx.doi.org/10.48550/ARXIV.2509.02492),2509\.02492Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p2.1)\.
- Wanget al\.\(2024a\)H\. Wang, W\. Xiong, T\. Xie, H\. Zhao, and T\. ZhangInterpretable preferences via multi\-objective reward modeling and mixture\-of\-experts\.CoRRabs/2406\.12845\.External Links:[Link](https://doi.org/10.48550/arXiv.2406.12845),[Document](https://dx.doi.org/10.48550/ARXIV.2406.12845),2406\.12845Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Wanget al\.\(2024b\)Z\. Wang, Y\. Dong, O\. Delalleau, J\. Zeng, G\. Shen, D\. Egert, J\. J\. Zhang, M\. N\. Sreedhar, and O\. KuchaievHelpSteer2: open\-source dataset for training top\-performing reward models\.CoRRabs/2406\.08673\.External Links:[Link](https://doi.org/10.48550/arXiv.2406.08673),[Document](https://dx.doi.org/10.48550/ARXIV.2406.08673),2406\.08673Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p2.1)\.
- Wuet al\.\(2025\)W\. Wu, X\. Guan, S\. Huang, Y\. Jiang, P\. Xie, F\. Huang, J\. Cao, H\. Zhao, and J\. ZhouMaskSearch: A universal pre\-training framework to enhance agentic search capability\.CoRRabs/2505\.20285\.External Links:[Link](https://doi.org/10.48550/arXiv.2505.20285),[Document](https://dx.doi.org/10.48550/ARXIV.2505.20285),2505\.20285Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Xionget al\.\(2025\)B\. Xiong, Y\. Lei, X\. Liu, S\. Zhang, P\. Zhu, Y\. Liu, Y\. Leng, L\. Shi, M\. Zhong, Y\. Zhang, Y\. Gao, Y\. Wu, Y\. Hu, and D\. XiongThink\-search\-patch: A retrieval\-augmented reasoning framework for repository\-level code repair\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, EMNLP 2025 \- Industry Track, Suzhou, China, November 4\-9, 2025,S\. Potdar, L\. M\. Rojas\-Barahona, and S\. Montella \(Eds\.\),pp\. 1555–1566\.External Links:[Link](https://doi.org/10.18653/v1/2025.emnlp-industry.109),[Document](https://dx.doi.org/10.18653/V1/2025.EMNLP-INDUSTRY.109)Cited by:[§3\.1](https://arxiv.org/html/2609.19827#S3.SS1.p2.1)\.
- Yaoet al\.\(2026\)Y\. Yao, H\. Zhu, P\. Wang, J\. Ren, X\. Yang, Q\. Chen, X\. Li, D\. Shi, J\. Li, Q\. Wang, S\. Wang, X\. Liu, J\. Wu, M\. Liu, and W\. ZhouO\-researcher: an open ended deep research model via multi\-agent distillation and agentic RL\.CoRRabs/2601\.03743\.External Links:[Link](https://doi.org/10.48550/arXiv.2601.03743),[Document](https://dx.doi.org/10.48550/ARXIV.2601.03743),2601\.03743Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p1.1)\.
- Yuet al\.\(2025\)Z\. Yu, J\. Zeng, W\. Gu, Y\. Wang, J\. Wang, F\. Meng, J\. Zhou, Y\. Zhang, S\. Zhang, and W\. YeRewardAnything: generalizable principle\-following reward models\.CoRRabs/2506\.03637\.External Links:[Link](https://doi.org/10.48550/arXiv.2506.03637),[Document](https://dx.doi.org/10.48550/ARXIV.2506.03637),2506\.03637Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p2.1)\.
- Yuanet al\.\(2024\)L\. Yuan, G\. Cui, H\. Wang, N\. Ding, X\. Wang, J\. Deng, B\. Shan, H\. Chen, R\. Xie, Y\. Lin, Z\. Liu, B\. Zhou, H\. Peng, Z\. Liu, and M\. SunAdvancing LLM reasoning generalists with preference trees\.CoRRabs/2404\.02078\.External Links:[Link](https://doi.org/10.48550/arXiv.2404.02078),[Document](https://dx.doi.org/10.48550/ARXIV.2404.02078),2404\.02078Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p2.1)\.
- Zhouet al\.\(2025\)E\. Zhou, G\. Zheng, B\. Wang, Z\. Xi, S\. Dou, R\. Bao, W\. Shen, L\. Xiong, J\. Fan, Y\. Mou, R\. Zheng, T\. Gui, Q\. Zhang, and X\. HuangRMB: comprehensively benchmarking reward models in LLM alignment\.InThe Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24\-28, 2025,External Links:[Link](https://openreview.net/forum?id=kmgrlG9TR0)Cited by:[§2](https://arxiv.org/html/2609.19827#S2.p2.1)\.
- Zhouet al\.\(2026\)J\. Zhou, Z\. Fan, X\. Wu, T\. Yu, F\. Zhang, and L\. WangDeep research pretraining via predictive navigation\.External Links:2608\.00432,[Link](https://arxiv.org/abs/2608.00432)Cited by:[§1](https://arxiv.org/html/2609.19827#S1.p1.1)\.

## Appendix ACase Study for DeepSearch Workflow

We present a user query and the corresponding response generated under the DeepSearch framework, which allows us to clearly understand how DeepSearch addresses complex user queries\. Due to space constraints, we provide a concise summary of the planning and reflection, information retrieval, and final summarization stages\.

ComponentContentUser QueryHow can I learn the language and pass the IELTS exam to work as a care worker in Australia? Please help me outline a detailed plan, investment costs, and important considerations\.Round 1Thinking & Planning: Identify the differences between care worker and registered nurse requirements, and check language thresholds\. Plan to search for care worker English requirements, study plans, and initial visa matters\.
Recall Information: 1\. Clear threshold: Care workers \(482 visa\) only need an IELTS score of 5\.0 \(no subscore below 4\.5 or 5\.0\), much lower than the 7\.0 required for registered nurses\. 2\. Basic study framework: A 3\-month preparation plan covering vocabulary and section\-specific practice\.
Summary: Established a study goal centered on an IELTS score of 5\.0 and built initial preparation logic\.Round 2Thinking & Planning: Deepen exploration of cost gaps \(Task 3 results were empty\) and career entry details\. Plan to search for 2026 updated exam fees, training costs, and Certificate III course details\.
Recall Information: 1\. 2026 cost update: IELTS exam fee reduced to 1990 RMB; PTE approximately 2255 RMB\. 2\. Clear qualification: Entry requires a Certificate III in Individual Support, with a study duration of 6–9 months\. 3\. Living costs: Rent and expenses are approximately 300–500 AUD per week\.
Summary: Filled in key facts on financial budgets and industry entry qualifications \(Cert III\)\.Round 3Thinking & Planning: Correct the assessment authority \(exclude ANMAC\) and complete the visa application loop\. Plan to search for ACWA assessment processes, compile visa checklists, and practical considerations\.
Recall Information: 1\. Authority correction: Care worker \(ANZSCO 423111\) skill assessment is primarily handled by ACWA\. 2\. Visa checklist: 482 visa requires employer sponsorship, skill assessment, medical examination, and police clearance\. 3\. Work reality: Annual salary approximately 330,000 RMB; full\-time work requires at least 5 days per week\.
Summary: Constructed a full\-chain execution map from language preparation to skill assessment, visa application, and life in Australia\.Final Answer1\.Language threshold: IELTS overall and subscores must reach 5\.0 \(or equivalent PTE score\), which is a requirement for visa and employment\.
2\.Core qualification: Must obtain an Australian Certificate III in Individual Support, including at least 120 hours of mandatory practical placement\.
3\.Visa pathway: Primarily enter via the 482 Employer Sponsored Visa, with three steps: employer sponsorship, position nomination, and individual visa application\.
4\.Cost\-benefit: Self\-study costs start at approximately 3,000 RMB; annual salary is about 50,000 AUD \(≈\\approx230,000 RMB\)\. Be prepared for high\-intensity physical work\.Table 6:Case Study: DeepSearch Workflow for Australian Care Worker Query\.
## Appendix BPrompts for F2DR

### B\.1Prompts for Content dimension

This prompt is the Content\-dimension evaluation template in F2DR, using checklist\-based scoring and JSON output to ensure consistent, objective assessments of DeepSearch content dimension\.

\#\# PersonaYou are aSenior Information Coverage Assessment Expert, specializing in evaluating the accuracy of Retrieved Content \(Reference\) against key Information Points \(Checklist\) derived from the User Query\.\#\# ObjectiveBased on the provided User Query, Retrieved References, and the Preset Information Checklist, analyze the coverage degree of each information point individually and provide an authoritative score\.\#\# Scoring CriteriaYou must strictly adhere to the following standards:\-1\.5 points \(Fully Covered\): The retrieved material contains the core facts of the information point, and the data/content in brackets is also consistent\.\-1\.0 point \(Basically Covered\): The retrieved material contains the core facts of the information point\.\-0\.5 points \(Partially Covered\): The retrieved material covers part of the content or mentions relevant information\.\-0 points \(Not Covered\): The retrieved material completely fails to mention this point, or the content logically conflicts with it\.\-Note: Assign 0 points only ifnoreferences mention the current information point\.\#\# Task Requirements1\.Deep Discrimination: Ignore surface keyword matching and focus on content semantics\. Exclude noise in search results that does not align with the user’s original intent\.2\.Classification:\-Main \(Primary Points\): The “cornerstone” of the answer; must be rigorously assessed\.\-Second \(Secondary Points\): Supplementary background; assess its contribution to professional depth\.3\.Reasoning Process: Before outputting JSON, first summarize the content of each ref, then reason one by one whether each information point is covered\.4\.Output Restriction: Finally, output a standard JSON array\.Strictly prohibitincluding any leading words or explanations\.\#\# Input InformationUser Query: \{Query\}Required Checklist: \{Check\_list\}Retrieved Refs: \{All\_refs\}\#\# Output Format<crm\>Summarize content of each ref: xxxMain Point 1: 1\.5, Reason: xxxMain Point 2: 0\.5, Reason: xxx…Second Point 1: 0, Reason: xxx</crm\><score\>\{\{“main1”: 1\.5, “main2”: 0\.5, …, “second1”: 0, …\}\}</score\>Now, please begin your assessment\.Table 7:Prompt for the Content Dimension in F2DR\.
### B\.2Prompts for Trajectory dimension

This prompt is the Trajectory\-dimension evaluation template in F2DR, using multi\-dimensional binary scoring to assess AI planning trajectory rationality and output structured results\.

\#\# PersonaYou are aRigorously Strict Search Strategy Evaluation Expert\. You must evaluate the planning reasoning process and the rationality of the query planning trajectory generated by the AI assistant withextreme objectivity and rigor\.Evaluation Objects1\.Reasoning Process: The complete reasoning on “how to answer” and “how to plan” after receiving the user query\.2\.Planning Trajectory: A DAG list of sub\-tasks\. Each sub\-task is a JSON object \(focus only onsearch/mcptypes;\-id: Unique identifier \(starts from ’1’\)\.\-type: ’search’, ’code’, ’mcp’\.\-para: Keywords list \(search/mcp\) or type description \(code\)\.\-desc: Clear guidance for execution\.Evaluation Dimensions & RulesScale: Only1 \(Pass\)or0 \(Fail\)\. Any deviation results in 0\. Focus heavily onNotes\(common errors\)\.I\. Task Level Dimensions1\. Intent Understanding Correctness\-Criteria: Exact match between reasoning and user intent\. Must identify explicit needs and all implicit constraints \(timeliness, professional depth, data range\)\.\-Note: Check if hidden user needs are satisfied\.2\. Search Task Atomicity\-Criteria: Each keyword inparamust be a semantic unit\. No multi\-entity/cross\-domain searches in one keyword\.\-Exception: Using the original user query verbatim is allowed\.3\. Reasoning\-Planning Consistency\-Criteria: Every assumption/gap in reasoning must map to a specific task in the trajectory\.\-Note: Watch for cases where reasoning identifies gaps but the DAG is empty\.II\. Trajectory Level Dimensions4\. Gap Resolution Degree\-Criteria: Clear trend ofentropy reduction\. Each task solves a specific gap\. No redundancy\.\-Note: Repetitive reasoning is NOT entropy reduction\.5\. Planning Comprehensiveness\-Criteria: Covers all explicit and implicit information dimensions \(core and secondary\) without omission\.\-Note: Watch for missing information dimensions\.6\. Reasoning Iteration Innovation\-Criteria: In multi\-round planning, each round must offer incremental value/optimization\. No exact repetition\. Secondary searches must require new keywords/angles\.\-Note: Watch for identical reasoning content across rounds\.\#\# Input InformationUser Query: \{query\}Planning History: \{plan\_search\_history\}\#\# Output FormatEncapsulate results in tags\. First summarize the reasoning, then score each dimension\.<trm\>Reasoning Summary: …Intent Understanding: \[1 or 0\], Reason: …Search Atomicity: \[1 or 0\], Reason: …Consistency: \[1 or 0\], Reason: …Gap Resolution: \[1 or 0\], Reason: …Comprehensiveness: \[1 or 0\], Reason: …Iteration Innovation: \[1 or 0\], Reason: …</trm\><score\>\[1, 1, 0, 1, 0, 1\] % Python List Format </score\>Now, please begin your assessment\.Table 8:The prompt for evaluating the Trajectory Dimension in F2DR\.
### B\.3Prompts for Answer dimension

This prompt is the Answer\-dimension evaluation template in F2DR, using three\-tier scoring and structured output to assess the quality of final answers in DeepSearch\.

\#\# PersonaYou are aRigorously Strict Search Strategy Evaluation Expert\. You must evaluate the final answer generated by the query planning AI assistant based on the user query withextreme objectivity and rigor\. Apply high standards throughout the scoring; do not award 1 point unless absolutely necessary\.General Evaluation Rules1\.Three\-Tier Scoring: All dimensions \(subjective and objective\) use three tiers:1 \(Excellent\),0\.5 \(Acceptable\),0 \(Unqualified\)\.2\.Independent Evaluation: When assessing subjective dimensions \(Dimensions 1–3\), do NOT refer to checklist items; judge only against the original user query\.3\.Precise Localization: When scoring 0\.5 or 0, clearly locate the exact problem in the reasoning\.I\. Subjective Evaluation Dimensions \(1 / 0\.5 / 0\)Dimension 1: Demand Understanding\- Core Criterion: Matching degree and full coverage of the answer to user demand\. Do NOT refer to checklist items for this dimension\.\- 1 \(Excellent\): Fully understands core user demand, covers all explicit key points, accurately identifies and satisfies potential implicit intent, with no omissions\.\- 0\.5 \(Acceptable\): Basically understands demand, fully covers explicit key points, but insufficiently identifies potential implicit intent \(e\.g\., background supplementation, comparison needs\) or has minor understanding deviations\.\- 0 \(Unqualified\): Misses core explicit demand or contains severe intent recognition errors\.Dimension 2: Content Quality\- Core Criterion: Completeness, conciseness, and logicality of the answer\. Do NOT refer to checklist items for this dimension\.\- 1 \(Excellent\): Detailed and substantial; extremely concise without redundancy; clearly focused with high information gain; perfectly logical and consistent\.\- 0\.5 \(Acceptable\): Basically complete but has minor flaws such as slight redundancy, minor repetition, unclear prioritization, or slightly rigid logical derivation\.\- 0 \(Unqualified\): Contains contradictions, massive repetition, chaotic logic, or severely insufficient information depth\.II\. Objective Evaluation Dimensions \(1 / 0\.5 / 0\)Dimension 3: Answer Coverage Rate\- Evaluation Basis: Based on the provided checklist, evaluate coverage ofcore information \(Main\)only\. Check only whether entity information is hit; ignore content in parentheses\.\- Three\-Tier Criteria:1: Core information \(Main\) hit rate≥60%\\geq 60\\%0\.5:25%≤Core information \(Main\) hit rate<60%25\\%\\leq\\text\{Core information \(Main\) hit rate\}<60\\%0: Core information \(Main\) hit rate<25%<25\\%\#\# Input InformationUser Query: \{query\}Required Information List: \{checklist\}Final Model Answer: \{answer\}\#\# Output Format Requirements<arm\>Answer Summary: xxxDemand Understanding: \[1/0\.5/0\], Reason: \[Evaluation based on Demand Understanding criteria\]Content Quality: \[1/0\.5/0\], Reason: \[Evaluation based on Content Quality criteria\]Answer Coverage: \[1/0\.5/0\], Reason: \[Specific hit ratio of core/supplementary info against checklist\]</arm\><score\>\[1, 0\.5, 0\.5\] % Python List Format </score\>Now, please begin your assessment\.Table 9:The prompt for evaluating the Answer Result Dimension in F2DR\.

## Appendix CPrompts for Self\-evaluation method

This is the prompt for the self\-evaluation prompt\.

\#\# PersonaYou are aRigorously Strict Search Strategy Evaluation Expert\. You must evaluate the planning reasoning process, the rationality of the planning trajectory, and the quality of the final answer generated by the query planning AI assistant based on the user query, withextreme objectivity and rigor\. You need to formulate your own scoring criteria to assign a score\.Evaluation TaskEvaluate the search effectiveness and final answer quality by judging the rationality of the search plan and adequacy of retrieved information, verifying whether the final answer can accurately respond to the user query, and assigning a decimal score between 0 and 1\.Input InformationUser Query: \{query\}Search Plan & History: \{history\_str\}Final Answer: \{answer\}Output FormatPlease strictly follow the format below:Detailed evaluation reason<score\>Score</score\>Table 10:The prompt for self\-evaluation\.
## Appendix DCase Study for F2DR

There is a case study on the checklist for user queries, the three evaluation dimensions of F2DR\.

ComponentContentUser QueryHow can I learn the language and pass the IELTS exam to work as a care worker in Australia? Please help me outline a detailed plan, investment costs, and important considerations\.Main Checklist Items1\. IELTS General Training \(General\) test type
2\. Basic IELTS requirement for Australian care workers \(overall 5\.0, no subscore below 5\.0\)
…\(omitted\)Secondary Checklist Items1\. IELTS requirement for Chinese employers
2\. Re\-examination fee \(2,170 RMB\)
…\(omitted\)Content EvaluationReference Summary:
\- refs\_ID 1–3: Cover IELTS requirement adjustments for Australian nursing occupations …\(omitted\)
Main Point 1 \(IELTS General Training test type\): 0\.5 points\. Reason:
…\(omitted\)Table 11:Checklist and Content Dimensional Evaluation for Australian Care Worker Query\.ComponentContentUser QueryHow can I learn the language and pass the IELTS exam to work as a care worker in Australia? Please help me outline a detailed plan, investment costs, and important considerations\.Trajectory EvaluationEvaluation Results
Summary of Thinking Process:
In response to the user’s query “How can I learn the language and pass the IELTS exam to work as a care worker in Australia? …\(omitted\)
\-Round 1: Identify core needs \(English requirements for care workers, IELTS study plan, cost estimation, precautions\), and plan 4 independent search tasks covering occupational requirements, preparation resources, fees, and visa information\.
…\(omitted\)
Intent Understanding Correctness: \[1 point\]\. Reason: Accurately identify explicit demands \(IELTS study plan,…\(omitted\)
Search Task Atomicity: \[1 point\]\. Reason: All keywords in search task paragraphs are semantically complete and indivisible …\(omitted\)
Reasoning\-Planning Consistency: \[1 point\]\. Reason: Key assumptions in thinking \(e\.g\., “costs need to estimate course fees and exam fees”\) and data gaps \(e\.g\., “unclear skills assessment authority”\)…\(omitted\)
Gap Resolution Degree: \[1 point\]\. Reason: The planning process shows a significant entropy reduction trend—the first round locates basic needs,…\(omitted\)
Reasoning Iteration Innovation: \[1 point\]\. Reason: It fully covers explicit dimensions \(language study plan, cost, precautions\)…\(omitted\)
Innovation of Thinking Iteration: \[1 point\]\. Reason: Each round of thinking achieves substantial optimization—the second round adjusts keywords based on the first round results…\(omitted\)Table 12:User Query and Trajectory Dimensional Evaluation for Australian Care Worker Query\.ComponentContentUser QueryHow can I learn the language and pass the IELTS exam to work as a care worker in Australia? Please help me outline a detailed plan, investment costs, and important considerations\.Answer Evaluation<arm\>
Summary of Answer Content: The model’s answer provides a comprehensive guide to language learning and IELTS preparation for working as a care worker in Australia,…\(omitted\)
Demand Understanding: \[1 point\]\. Reason:…\(omitted\)
Content Quality: \[1 point\]\. Reason: The content is detailed and complete \(phased plan table, …\(omitted\)
Answer Coverage: \[0\.5 points\]\. Reason: The hit rate of core information \(Main\) is 50% \(7/14\)\. …\(omitted\)</arm\>
<score\> \[1, 1, 0\.5\]</score\>Table 13:User Query and Answer Dimensional Evaluation for Australian Care Worker Query\.ComponentContentUser QueryHow can I learn the language and pass the IELTS exam to work as a care worker in Australia? Please help me outline a detailed plan, investment costs, and important considerations\.Self\-evaluation1\.Rationality of Search Planning: The model adopted a 4\-round progressive search strategy,…\(omitted\)
2\.Completeness of Information Acquisition: Successfully obtained core information such as care worker\-specific IELTS score requirements …\(omitted\)
3\.Quality of Final Answer: The answer has a clear structure, framed as …\(omitted\)<score\>0\.93</score\>

Table 14:User Query and Self\-evaluation result for Australian Care Worker Query\.
## Appendix EGSB evaluation

The industrial\-grade human evaluation system adopted for GSB validation consists of 5 rating levels, centering on five core dimensions: intent understanding, content accuracy, information value, professionalism, and scenario adaptability\. The detailed grading criteria are as follows:

- •4 \(Excellent\): Accurately understands all user intents and perfectly addresses the problem; content is accurate, timely, and authoritatively traceable, rich in actionable information; well\-written with no missing information, high professionalism supported by case data, clear decision\-making, appropriate format, and natural conversational tone\.
- •3 \(Satisfactory\): Accurately understands core intents and meets primary requirements; content is generally accurate, meets timeliness and authority standards, and contains no invalid information; coherent expression, complete information, basic professionalism, clear decision\-making, and smooth conversation\.
- •2 \(Marginally Satisfactory\): Basically understands intents and only meets basic requirements; main content is correct but lacks timeliness and authority, with minor deviations and redundancy; no critical information missing, average professionalism, no case support, and thin content\.
- •1 \(Poor\): Only marginally aligns with intents and fails to effectively solve the problem; content contains numerous errors, lacks timeliness and authority, and provides little useful information; critical information missing, no professionalism, inappropriate format, poor conversational quality, and memory errors\.
- •0 \(Unsatisfactory or Red Line\): Completely deviates from intents and provides irrelevant responses; content is false or erroneous, violates legal red lines, outputs negative or inappropriate information, and has no valid value\.

AnnotatorsGoodSimpleBadAnnotator 121251Annotator 221023Annotator 322453Annotator 420932Annotator 521564Table 15:Inter\-Annotator Rating DistributionThe rating results from the annotators, scored in accordance with the specified criteria, are presented in Table[15](https://arxiv.org/html/2609.19827#A5.T15)\.

## Appendix FSupplemental Information for Experiment

### F\.1Study on F2DR Evaluation Dimension Weights

We conduct a F2DR dimension weight ablation study \(Table 16\) on DeepSeek\-R1\. Evaluating all 0\.75,1\.00,1\.25 permutations across three dimensions, our setting \(0\.75:1\.00:1\.25\) achieves the highest 85\.79% match rate, validating the design\.

WeightsDeepSeek\-R1Qwen3\-235B\-A22B\-ThinkingGPT\-5Claude 4\.5Sonnetdoubao\-Seed\-1\.8setting1 1\.00:1\.00:1\.0083\.5273\.7568\.9368\.4771\.03setting2 0\.75:1\.25:1\.0084\.7674\.8768\.2367\.8270\.61setting3 1\.00:0\.75:1\.2581\.9673\.2167\.4566\.1665\.98setting4 1\.00:1\.25:0\.7584\.5772\.9467\.3064\.0968\.24setting5 1\.25:0\.75:1\.0083\.8374\.0564\.1765\.2867\.98setting6 1\.25:1\.00:0\.7584\.3072\.1165\.3466\.6770\.46setting7 0\.75:1\.00:1\.2585\.7974\.9569\.2568\.8770\.56Table 16:Study on F2DR Dimension Weights Across Models\.

## Appendix GAnnotator Information

Our annotators are all in\-house employees\. We have a total of 5 annotators, each earning 500 RMB per day\. On average, each staff member produces around 100 data entries daily, and the entire annotation period lasts approximately 10 days\. They are mainly responsible for preference\-based data verification, as well as scoring and filtering of GSB\-based data\.