Agentic-Ideation: Sample Efficient Agentic Trajectories Synthesis for Scientific Ideation Agents

# Agentic-Ideation: Sample Efficient Agentic Trajectories Synthesis for Scientific Ideation Agents
Source: [https://arxiv.org/html/2606.31229](https://arxiv.org/html/2606.31229)
###### Abstract

Ideation plays a pivotal role in scientific discovery\. Recent LLM, especially AI Scientist systems, show promising potential for automated ideation\. However, existing approaches predominantly rely on pre\-defined agentic workflows\. This constraint severely limits the flexibility required to navigate the vast search space of scientific literature and the complex action space of research reasoning\. Recently, training Agentic LLMs has emerged as a promising direction, offering flexible reasoning frameworks and the capability for autonomous tool utilization\. However, there remains a non\-trivial challenge: applying previous agentic data synthesis methods to scientific ideation suffers from prohibitively high data synthesis cost\. To bridge this gap, we propose Agentic\-Ideation, a novel framework comprising an automated trajectory synthesis pipeline and a specialized agentic LLM trained for scientific ideation\. Specifically, we first define a comprehensive tool space incorporating three external tools and three cognitive tools\. Then we introduce an Oracle\-Guided Data Synthesis strategy\. By leveraging a reference idea as oracle guidance, this approach steers the multi\-agent system to efficiently reconstruct the logical reasoning and tool invocation paths, transforming aimless trial\-and\-error into directed trajectory generation\. Finally, we train the agent on these synthesized trajectories, employing a masking strategy on tool execution results\. This ensures the model focuses on decision\-making logic without interference from external feedback\. Experimental results demonstrate that our method outperforms the SOTA workflow\-based baseline by11\.91%in overall quality\. Furthermore, our approach improves the sample efficiency of high\-quality data synthesis byover 10×\\times\.

Machine Learning, ICML

## 1Introduction

Scientific ideation serves as the genesis of the entire research lifecycle, fundamentally determining the novelty and potential impact of downstream discoveries\. Recently, the rapid evolution of Large Language Models \(LLMs\) has catalyzed the vision of an "AI Scientist"\(Tanget al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib1); Luet al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib2); Schmidgallet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib7)\), capable of automating complex research tasks ranging from initial idea generation\(Yuet al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib5); Puet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib6)\)to final manuscript preparation\(Wanget al\.,[2024b](https://arxiv.org/html/2606.31229#bib.bib9); Yanet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib10); Lianget al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib11)\)\.

Despite this priority, previous approaches predominantly rely on pre\-defined workflows\(Liet al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib16); Zhouet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib17)\)\. These methods typically constrain Large Language Models \(LLMs\) to execute pre\-defined, linear sequences, such as literature retrieval followed by template filling\. Crucially, the efficacy of these rigid pipelines depends heavily on complex, human\-designed prompts meticulously crafted to guide the model through each step\. This reliance on static, hand\-crafted engineering restricts flexibility\(Shanget al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib18); Huet al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib19)\), failing to navigate the vast search space of literature where researchers must adaptively select tools and refine reasoning\. To transcend these limitations, training Agentic LLMs has emerged as a promising frontier\. Unlike static workflows, agentic models offer a flexible reasoning framework with the potential to autonomously orchestrate tools and adaptively navigate the research space without being bound by brittle scripts\(Jinet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib23); Chenet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib24)\)\.

However, training such agentic models is non\-trivial, primarily due to the challenge of efficiently synthesizing high\-quality agentic trajectory data\. Existing data synthesis frameworks for agents generally focus on tasks with definite answers, such as multi\-hop Question Answering \(QA\)\(Taoet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib21); Liet al\.,[2025a](https://arxiv.org/html/2606.31229#bib.bib25)\)\. In these scenarios, high\-quality trajectories are typically filtered via rejection sampling\(Liet al\.,[2025b](https://arxiv.org/html/2606.31229#bib.bib22)\), where the correctness of the final answer serves as a clear ground truth signal to validate the reasoning path\. Unfortunately, this paradigm is ill\-suited for scientific ideation\. Unlike QA, ideation involves a vast and open\-ended answer space where no single "correct" solution exists\(Zhanget al\.,[2025a](https://arxiv.org/html/2606.31229#bib.bib26); Calicet al\.,[2020](https://arxiv.org/html/2606.31229#bib.bib27)\)\. Consequently, applying standard rejection sampling leads to prohibitively low sample efficiency, as unguided models struggle to navigate this immense search space to yield high\-quality ideas, rendering the data synthesis process computationally expensive and ineffective\.

To tackle these challenges, we introduce Agentic\-Ideation, a comprehensive framework designed for efficient agentic data synthesis and robust model training\. We first meticulously define the agent’s hybrid tool space, which comprises three external tools and three thinking tools\. The external tools, includingSearch,Get\_ReferencesandGet\_Cited, empower the agent to access external APIs, thereby proactively expanding its knowledge boundaries beyond its internal parameters\. Complementing these, the thinking tools, includingAnalyse\_Gap,IdeationandReflection, enable the agent to perform critical cognitive tasks, such as identifying research voids and iteratively refining ideas\. To synthesize high\-quality trajectories based on this action space, we construct a hierarchical multi\-agent system consisting of a Planner, a Controller, and six specialized tool agents\. In this architecture, the Planner orchestrates the high\-level ideation strategy, while the Controller manages fine\-grained tool selection and execution at each step\.

Notably, we endow agents with an oracle view of the high\-quality "reference idea," acting as a navigational beacon to maximize sample efficiency\. Instead of aimlessly exploring the vast action space, this guidance transforms the synthesis process from a stochastic search into a directed trajectory reconstruction\. By leveraging this "foresight," the system can generate a valid, logically coherent reasoning path in a single pass\. This fundamentally circumvents the massive computational waste inherent in traditional rejection sampling, where valid trajectories are sparsely distilled only after exhaustive, undirected "hindsight" trial\-and\-error\. Finally, we utilize these high\-quality trajectories to train the target agent, equipping it with the capability to perform grounded reasoning and autonomous exploration for open\-ended scientific ideation\. During this phase, we apply a strategic masking technique to the results returned by external tools\. This critical design forces the model to focus on the reasoning behind tool invocation rather than memorizing specific return values, thereby avoiding interference from external feedback during the learning process and ensuring the generalization and robustness of the trained agent\.

Extensive experiments demonstrate the superiority of our proposed framework\. Quantitatively, our trained agentic LLM consistently outperforms all competitive baselines, achieving an 11\.91% improvement in overall score compared to the state\-of\-the\-art method, which empirically validates the effectiveness of our proposed agentic training paradigm\. In terms of data construction, our approach achieves a remarkable efficiency boost, accelerating the synthesis of high\-quality agentic trajectories by over tenfold compared to previous rejection sampling strategies\. Furthermore, a comprehensive human evaluation confirms that the ideas generated by our agent exhibit higher novelty, feasibility, and scientific value, validating the practical utility of our method in real\-world research scenarios\.

Our contributions can be summarized as follows:

1. 1\.We pioneer the application of agentic LLMs to scientific ideation, offering a flexible and autonomous alternative to existing rigid, workflow\-based approaches\. This paradigm shift enables the model to adaptively navigate the complex search space of scientific ideas\.
2. 2\.We propose a novel oracle\-guided multi\-agent data synthesis framework\. By leveraging a global view to guide trajectory generation, we address the challenge of data scarcity and significantly enhance sample efficiency in the open\-ended ideation domain\.
3. 3\.We achieve SOTA results across all metrics, outperforming strong baselines and improving synthesis efficiency by over tenfold\. Furthermore, human evaluation confirms our method generates more novel and feasible ideas\.

## 2Related Works

### 2\.1Scientific Ideation

![Refer to caption](https://arxiv.org/html/2606.31229v1/x1.png)Figure 1:Overview of the proposed AgenticIdeation includesOracle\-Guided Agentic Data SynthesisandAgentic Supervised Fine\-Tuning\. The system utilizes Oracle guidance to synthesize high\-quality research trajectories, which are subsequently used to fine\-tune the model with a masking strategy applied to tool execution results\.The pursuit of AI Scientists envisions systems capable of automating the entire research lifecycle\(Yamadaet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib3); Gottweiset al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib4); Schmidgall and Moor,[2025](https://arxiv.org/html/2606.31229#bib.bib8)\)\. Central to this vision is Scientific Ideation, the foundational upstream phase that determines the novelty and validity of downstream experimentation\(Novikovet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib28); Romera\-Paredeset al\.,[2023](https://arxiv.org/html/2606.31229#bib.bib29)\)\. While recent works have explored various generation strategies\. ResearchAgent\(Baeket al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib31)\)augments idea generation by utilizing a scientific knowledge graph and an iterative peer review mechanism, while SciPiP\(Wanget al\.,[2024a](https://arxiv.org/html/2606.31229#bib.bib32)\)employs a dual\-path framework combining retrieval\-based and generative approaches to balance novelty and feasibility\. Focusing on uniqueness, SciMON\(Wanget al\.,[2023](https://arxiv.org/html/2606.31229#bib.bib33)\)explicitly optimizes for novelty by iteratively retrieving inspirations from past literature to refine hypotheses, whereas VirSci\(Suet al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib34)\)simulates a virtual research team where multiple agents collaboratively propose and evaluate ideas\. Despite their specific innovations, these approaches share a critical limitation: they rely on fixed, static workflows driven by complex human\-designed prompts\. This rigidity constrains the model to follow pre\-defined procedures, preventing the autonomous flexibility required for truly open\-ended scientific exploration\.

### 2\.2Agentic Data Synthesis

Distinct from rigid workflow\-based systems, Agentic LLMs are defined by their autonomy in planning and invoking external tools to solve open\-ended problems\. To equip models with these capabilities, Agentic Data Synthesis shifts the training paradigm from learning static text to mimicking dynamic interaction trajectories, explicitly capturing the interplay between reasoning, tool execution, and environmental feedback\. Recent works employ diverse strategies to synthesize agentic training data\. AgentScaler\(Fanget al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib35)\)automates experience accumulation by formalizing environments as read\-write databases to generate interaction logs, while WebDancer\(Wuet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib20)\)captures end\-to\-end browser trajectories specifically tailored for complex "Deep Research" retrieval\. Addressing reasoning depth, WebSailor\(Liet al\.,[2025b](https://arxiv.org/html/2606.31229#bib.bib22)\)synthesizes high\-difficulty tasks through graph sampling and information obfuscation, whereas WebWatcher\(Genget al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib36)\)extends synthesis to the multimodal domain by integrating visual web contexts\. However, these methods typically depend on outcome\-based filtering mechanisms \(e\.g\., rejection sampling or task completion verification\) to ensure data quality\. In the vast, open\-ended answer space of scientific ideation, where unique ground truth or immediate success signals are absent, such strategies suffer from extremely low sample efficiency, as unguided exploration fails to consistently yield high\-quality outcomes without explicit directional guidance\.

## 3Methodology

The Agentic\-Ideation framework streamlines autonomous scientific discovery through three integrated stages\. First, we establish a hybrid tool space that combines external retrieval utilities with internal cognitive tools to support complex reasoning\. Second, to overcome data scarcity, we employ an oracle\-guided multi\-agent system where a Planner and Controller, guided by "reference ideas," efficiently synthesize high\-fidelity trajectories without relying on inefficient trial\-and\-error\. Finally, the target LLM is trained via Supervised Fine\-Tuning, where tool outputs are masked to ensure the model learns robust decision\-making logic rather than memorizing external feedback\. The overall framework of Agentic\-Ideation are presented in Figure[1](https://arxiv.org/html/2606.31229#S2.F1)\.

### 3\.1Agentic Tool Space Definition

Scientific ideation is inherently an iterative cognitive process that oscillates between the extensive accumulation of domain knowledge and the intensive synthesis of novel ideas\. To faithfully model this complex behavior, we define a comprehensive Agentic Tool Space that bridges the gap between retrieving external evidence and performing internal reasoning\. We formalize this space as𝒯=𝒯e​x​t∪𝒯t​h​i​n​k\\mathcal\{T\}=\\mathcal\{T\}\_\{ext\}\\cup\\mathcal\{T\}\_\{think\}, where𝒯e​x​t\\mathcal\{T\}\_\{ext\}denotes external retrieval tools and𝒯t​h​i​n​k\\mathcal\{T\}\_\{think\}represents internal reasoning tools\. Letℋ\\mathcal\{H\}denote the current interaction history\.

External Tools \(𝒯e​x​t\\mathcal\{T\}\_\{ext\}\)These tools interface with the academic database\. Notably, to simulate realistic constraints, only the search tool returns full details, while citation tools provide broad, shallow context\.

- •Search​\(q\)→𝒟m​e​t​a\\textit\{Search\}\(q\)\\rightarrow\\mathcal\{D\}\_\{meta\}: Queries the database with keywordsqq\. It returns a set of papers𝒟m​e​t​a\\mathcal\{D\}\_\{meta\}containing comprehensive metadata \(e\.g\., abstract, citation count, publication year\), serving as the primary source for detailed information acquisition\.
- •Get\_References​\(di​d\)→ℒt​i​t​l​e​s\\textit\{Get\\\_References\}\(d\_\{id\}\)\\rightarrow\\mathcal\{L\}\_\{titles\}: Retrieves the bibliography of a target paperdi​dd\_\{id\}\. It returns a list of titles only, allowing the agent to quickly scan the foundational roots of a work without overloading the context\.
- •Get\_Cited​\(di​d\)→ℒt​i​t​l​e​s\\textit\{Get\\\_Cited\}\(d\_\{id\}\)\\rightarrow\\mathcal\{L\}\_\{titles\}: Identifies papers that have citeddi​dd\_\{id\}\. Similarly, it returns a list of titles only, enabling the agent to efficiently map the downstream evolution and future trends related to the target paper\.

Thinking Tools \(𝒯t​h​i​n​k\\mathcal\{T\}\_\{think\}\)These tools model latent cognitive steps, mapping the contextℋ\\mathcal\{H\}to explicit reasoning outputsoo\.

- •Analyse\_Gap​\(ℋ\)→og​a​p\\textit\{Analyse\\\_Gap\}\(\\mathcal\{H\}\)\\rightarrow o\_\{gap\}: Synthesizes the retrieved information inℋ\\mathcal\{H\}to identify logical inconsistencies or underexplored intersections, explicitly outputting a "research void"og​a​po\_\{gap\}\.
- •Ideation​\(ℋ,og​a​p\)→oi​d​e​a\\textit\{Ideation\}\(\\mathcal\{H\},o\_\{gap\}\)\\rightarrow o\_\{idea\}: The core generative action\. Based on the identified gapog​a​po\_\{gap\}, it proposes a novel scientific ideaoi​d​e​ao\_\{idea\}, detailing the innovation and expected advantages\.
- •Reflection​\(ℋ,oi​d​e​a\)→oe​v​a​l\\textit\{Reflection\}\(\\mathcal\{H\},o\_\{idea\}\)\\rightarrow o\_\{eval\}: A self\-correction mechanism that critically evaluates the quality of generated ideaoi​d​e​ao\_\{idea\}, outputting a critiqueoe​v​a​lo\_\{eval\}to trigger refinement if necessary\.

### 3\.2Oracle\-Guided Agentic Data Synthesis

To systematically synthesize agentic trajectories, we design a hierarchical multi\-agent system operating on the defined tool space𝒯\\mathcal\{T\}\. The process initiates by selecting a scientific paper, termed the "Anchor Paper," and extracting its bibliography to serve as the system input\. The system then decomposes the ideation process into strategic planning and tactical execution, formalized as follows:

- •Planner\(Ap​l​a​nA\_\{plan\}\): Acts as the architect\. Given the initial contextℋ0\\mathcal\{H\}\_\{0\}\(derived from the anchor paper’s references\), the planner generates a high\-level research roadmapPPto structure the exploration: P=Ap​l​a​n​\(ℋ0\)P=A\_\{plan\}\(\\mathcal\{H\}\_\{0\}\)
- •Controller\(Ac​t​r​lA\_\{ctrl\}\): Acts as the executor\. At each time steptt, guided by the roadmapPP, the controller processes the current interaction historyℋt\\mathcal\{H\}\_\{t\}to generate a reasoning thoughtT​htTh\_\{t\}and a subsequent actionata\_\{t\}: \(T​ht,at\)=Ac​t​r​l​\(ℋt,P,Ir​e​f\)\(Th\_\{t\},a\_\{t\}\)=A\_\{ctrl\}\(\\mathcal\{H\}\_\{t\},P,I\_\{ref\}\)whereat∈𝒯a\_\{t\}\\in\\mathcal\{T\}denotes the specific tool invoked to acquire new information or perform reasoning\.

- •Private Thought\(t​hp​r​i​v\(t\)th\_\{priv\}^\{\(t\)\}\): Represents theOracle View\. It explicitly utilizesIr​e​fI\_\{ref\}to perform a gap analysis between the current state and the target goal\. This stream calculates the optimal toolata\_\{t\}required to bridge the gap, effectively collapsing the search space by providing directional foresight\.
- •Public Thought\(t​hp​u​b\(t\)th\_\{pub\}^\{\(t\)\}\): Represents theResearcher View\. It rationalizes the decisionata\_\{t\}using only the currently available historyℋt\\mathcal\{H\}\_\{t\}, intentionally masking the existence ofIr​e​fI\_\{ref\}\. This ensures the resulting reasoning trace mimics a natural, autonomous exploration process suitable for training\.

![Refer to caption](https://arxiv.org/html/2606.31229v1/x2.png)Figure 2:Comparsion betweenReject Samplingand ourOracle Guided strategy\.However, utilizing this system directly for data synthesis suffers from severe inefficiency, as shown in Figure[2](https://arxiv.org/html/2606.31229#S3.F2)\. A naive approach relies on rejection sampling as a quality filter, where a generated trajectoryτ\\tauis retained only if its final ideaoi​d​e​ao\_\{idea\}matches the anchor paper’s core idea\. In the vast, open\-ended search space of scientific ideation, an unguided agent rarely converges spontaneously on a specific target, resulting in a prohibitively high rejection rate\. To address this, we propose an Oracle\-Guided Strategy by injecting the anchor paper’s core idea, denoted as the Reference Idea \(Ir​e​fI\_\{ref\}\), into the inference process\. Specifically, we implement a Dual\-Thought Mechanism where the controller simultaneously generates two distinct cognitive streams\. Formally, the policy at stepttis defined as:

\(t​hp​r​i​v\(t\),t​hp​u​b\(t\),at\)=Ac​t​r​l​\(ℋt,P,Ir​e​f\)\(th\_\{priv\}^\{\(t\)\},th\_\{pub\}^\{\(t\)\},a\_\{t\}\)=A\_\{ctrl\}\(\\mathcal\{H\}\_\{t\},P,I\_\{ref\}\)The two thought components function as follows:

The synthesis process concludes when the agent invokes theReflectiontool\. The system evaluates the semantic alignment between the generated ideaoi​d​e​ao\_\{idea\}andIr​e​fI\_\{ref\}\. Only trajectories where the generated idea successfully recovers the reference idea are preserved for the subsequent training phase\.

### 3\.3Agentic Supervised Fine\-Tuning

To transform the diverse interaction traces generated by our multi\-agent system into a format suitable for LLM training, we employ a structured linearization strategy\. The input to the model consists of a system prompt defining the tool space𝒯\\mathcal\{T\}and the user query containing the references of the anchor paper\. Crucially, to ensure the trained agent learns autonomous exploration rather than "cheating," we exclusively retain the Public Thought \(t​hp​u​bth\_\{pub\}\) from the controller’s dual\-stream output as the primary reasoning chain, discarding the Private Thought \(t​hp​r​i​vth\_\{priv\}\) and the Oracle’s guidance\. The training sequence is rigorously organized using special tokens: external tool queries are encapsulated as<Tool\_Name\>Query</Tool\_Name\>, environmental observations are wrapped in<Result\>Output</Result\>, and internal cognitive actions are formatted as<Tool\_Name\>Content</Tool\_Name\>, culminating in the final output marked by<Answer\>Final Idea</Answer\>\. The structure of the trajectory is shown in the Figure[3](https://arxiv.org/html/2606.31229#S3.F3)\.

TrajectoryI should first gather relevant literature…<Get\_References\>\(Tool Call Query\)</Get\_References\><Result\>\(Tool Call Result\)</Result\>I need to dig deeper into how it’s used in practice…<Search\>\(Tool Call Query\)</Search\><Result\>\(Tool Call Result\)</Result\>Let me reflect on what’s still missing or underexplored\.<Analyse\_Gap\>\(Analysing current gap\)</Analyse\_Gap\>I now have enough context to propose a new idea\.<Ideation\>\(Generating Idea…\)</Ideation\>Figure 3:The structure of an agentic trajectory training data\.For model training, we utilize a Supervised Fine\-Tuning \(SFT\) approach\. Following\(Chenet al\.,[2023](https://arxiv.org/html/2606.31229#bib.bib37); Jinet al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib23); Zhanget al\.,[2025b](https://arxiv.org/html/2606.31229#bib.bib38)\), we mask tool execution results during loss calculation to ensure training performance and robustness\. This design prevents the model from memorizing deterministic environmental feedback, forcing it to focus solely on reasoning and decision\-making\. The optimization objective is defined as:

ℒ​\(θ\)=−1∑t=1\|X\|Mt​∑t=1\|X\|Mt⋅log⁡Pθ​\(xt∣x<t\)\\mathcal\{L\}\(\\theta\)=\-\\frac\{1\}\{\\sum\_\{t=1\}^\{\|X\|\}M\_\{t\}\}\\sum\_\{t=1\}^\{\|X\|\}M\_\{t\}\\cdot\\log P\_\{\\theta\}\(x\_\{t\}\\mid x\_\{<t\}\)
whereXXrepresents the complete linearized token sequence, andxtx\_\{t\}denotes thett\-th token\.x<tx\_\{<t\}represents the context precedingxtx\_\{t\}, andPθP\_\{\\theta\}is the conditional probability distribution parameterized by the model weightsθ\\theta\. The binary maskMt∈\{0,1\}M\_\{t\}\\in\\\{0,1\\\}serves as the indicator function:Mt=1M\_\{t\}=1ifxtx\_\{t\}belongs to the agent’s generated actions \(thoughts or tool calls\), andMt=0M\_\{t\}=0ifxtx\_\{t\}belongs to system instructions or environmental feedback \(tokens within <Result\>…</Result\>\)\. This ensures gradients are back\-propagated exclusively through the agent’s autonomous decisions\.

## 4Experiments

### 4\.1Experimental Setup

Baselines\.To comprehensively evaluate the performance of our proposed framework, we compare Agentic\-Ideation against four representative workflow\-based ideation systems and the foundation model itself\.

- •ResearchAgent\(Baeket al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib31)\):An iterative framework that augments ideation using a scientific knowledge store\. It refines ideas through simulated peer reviews generated by "ReviewingAgents\."
- •SciPIP\(Wanget al\.,[2024a](https://arxiv.org/html/2606.31229#bib.bib32)\):A dual\-path mechanism that integrates retrieval\-based knowledge extraction with generative brainstorming to balance the novelty and feasibility of proposed ideas\.
- •SciMON\(Wanget al\.,[2023](https://arxiv.org/html/2606.31229#bib.bib33)\):A system that explicitly optimizes for novelty\. It iteratively retrieves "inspirations" from past literature and refines generated ideas until they sufficiently diverge from retrieved prior works\.
- •VirSci\(Suet al\.,[2024](https://arxiv.org/html/2606.31229#bib.bib34)\):A multi\-agent collaboration framework \("Many Heads Are Better Than One"\) that simulates a team of virtual scientists to collaboratively propose and evaluate ideas through structured discussion\.
- •Qwen3\-8B\(Yanget al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib39)\):The backbone model used in our method\. We evaluate its zero\-shot performance using standard prompting to quantify the specific gains achieved by our agentic fine\-tuning\.

Table 1:Performance of Agentic\-Ideation compared to state\-of\-the\-art baselines across NLP, CV, and Other domains\. Bold and underline indicate the best and second\-best performance, respectively\.∗denotes statistical significance \(p​\-value<0\.05p\\text\{\-value\}<0\.05\) compared to the second\-best result\.MethodNLPCVOthersOverallNov\.Sig\.Fea\.OverallNov\.Sig\.Fea\.OverallNov\.Sig\.Fea\.OverallNov\.Sig\.Fea\.OverallResearchAgent5\.677\.135\.646\.016\.026\.845\.615\.946\.056\.865\.545\.865\.916\.945\.605\.94SciPIP5\.826\.925\.715\.976\.167\.035\.546\.026\.186\.945\.635\.966\.056\.965\.635\.88SciMON5\.727\.055\.545\.876\.096\.935\.625\.996\.287\.025\.596\.036\.037\.005\.585\.96VirSci5\.716\.895\.675\.935\.936\.915\.505\.946\.226\.865\.386\.015\.956\.895\.525\.81Qwen\-3\-8B5\.627\.085\.595\.906\.076\.895\.465\.856\.016\.915\.246\.105\.906\.965\.435\.90Agentic\-Ideation6\.56∗7\.88∗6\.21∗6\.64∗6\.74∗7\.65∗6\.13∗6\.69∗6\.92∗7\.82∗6\.02∗6\.69∗6\.74∗7\.78∗6\.12∗6\.67∗Improvement↑\\uparrow 12\.71%10\.52%8\.76%10\.48%9\.42%8\.82%9\.07%11\.13%10\.19%11\.40%6\.93%9\.67%11\.40%11\.14%8\.70%11\.91%

Dataset\.We construct a high\-quality dataset derived from accepted papers at three top\-tier machine learning conferences: ICLR 2025, ICML 2025, and NeurIPS 2025\. These papers serve as "Anchor Papers\." To ensure data integrity, we filter out papers where the abstract or bibliography is inaccessible\. To facilitate fine\-grained evaluation, we employ GPT\-5\-mini to classify these papers into three distinct domains: Natural Language Processing \(NLP\), Computer Vision \(CV\), and Others\.

For the test set, we focus on the most recently published conference, NeurIPS 2025, to assess the model’s ability to generate cutting\-edge ideas\. Specifically, we randomly sample 100 papers from each category \(NLP, CV, Others\), creating a balanced evaluation benchmark of 300 papers\. For each anchor paper in both training and testing sets, we randomly select 10 references from its bibliography\. These references serve as the sole input context, challenging the models to generate high\-quality scientific ideas based strictly on this foundational knowledge\.

Evaluation Metrics\.Following established protocols in automated scientific discovery, we employ four distinct metrics to evaluate the generated ideas\. These metrics are scored on a Likert scale \(e\.g\., 1\-10\)\. More details can be found in the Appendix[A\.1](https://arxiv.org/html/2606.31229#A1.SS1)\.

- •Novelty:Measures the degree of innovation and distinctiveness of the idea compared to existing literature\.
- •Significance:Assesses the potential impact and scientific value of the proposed idea to the research community\.
- •Feasibility:Evaluates the technical plausibility and implementation practicality of the proposed method\.
- •Overall:A holistic score reflecting the general quality and completeness of the scientific idea\.

Implementation Details\.During the data synthesis phase, to ensure the highest quality of "Oracle" guidance, we utilize the powerful Qwen3\-235B\-A22B\-Instruct\-2507\(Yanget al\.,[2025](https://arxiv.org/html/2606.31229#bib.bib39)\)as the underlying LLM for all agents \(Planner, Controller, and Tools\) within the oracle\-guided multi\-agent system\. For the Agentic training phase, we employ Qwen3\-8B as the backbone for the target agentic LLM, which is fine\-tuned on a dataset comprising 4,646 synthesized trajectories\. Please refer to Appendix[A\.2](https://arxiv.org/html/2606.31229#A1.SS2)for further implementation details\.

To ensure a rigorous comparison, all baseline methods \(ResearchAgent, SciPIP, SciMON, VirSci\) are implemented using GPT\-4o as the underlying engine, representing a strong closed\-source benchmark\.

Given the complexity of scientific ideation, we adopt a "Panel of LLM Judges" approach to mitigate single\-model bias\. We employ four state\-of\-the\-art models as evaluators: GPT\-5\.2, Gemini\-3\-Pro\-Preview, Claude\-Sonnet\-4\.5, and Qwen3\-Max\. The reported scores are the averaged results across these four judges\.

### 4\.2Main Result

Table[1](https://arxiv.org/html/2606.31229#S4.T1)presents the comprehensive evaluation results\. Agentic\-Ideation achieves state\-of\-the\-art performance, consistently outperforming all baselines\. Specifically, our method achieves an Overall score of 6\.67, surpassing the best\-performing baseline by 11\.91%\. We observe significant gains across Novelty \(\+11\.40%\), Significance \(\+11\.14%\), and Feasibility \(\+8\.70%\), demonstrating the robustness of our approach across NLP, CV, and Other domains\.

Comparison with Workflow\-based Baselines\.Compared to workflow\-based systems \(e\.g\., ResearchAgent, SciPIP\), Agentic\-Ideation exhibits superior adaptability\. While baselines are constrained by rigid, pre\-defined execution loops, our agentic framework empowers the Controller to dynamically navigate the research space—backtracking or reflecting as needed\. This autonomy allows the model to escape local optima that limit static workflows, resulting in ideas with significantly higher Novelty and Significance\.

Comparison with Backbone Model\.Comparison with the Qwen3\-8B backbone highlights the critical role of active tool use\. While the backbone relies solely on parametric knowledge, often leading to generic or unverified proposals, Agentic\-Ideation leverages the Agentic Tool Space to ground reasoning in real\-world literature\. By verifying assumptions against retrieved evidence \(e\.g\., via Get\_References\), our agent significantly boosts Feasibility \(e\.g\., \+12\.71% in NLP\), ensuring generated ideas are not just creative but technically sound\.

### 4\.3Efficiency of Data Synthesis

Table[2](https://arxiv.org/html/2606.31229#S4.T2)highlights the critical efficiency gap\. Rejection Sampling proves prohibitively inefficient, averaging 12 attempts to harvest a single valid sample\. This stems from the vast, open\-ended nature of scientific ideation, where unguided agents rarely converge spontaneously on the target idea, leading to massive computational waste\. In contrast, Agentic\-Ideation achieves optimal efficiency, requiring only 1 rollout per sample\. By leveraging our Oracle\-Guided Strategy, the system uses "foresight" to ensure the necessary logic and tool invocations are generated in a single pass\. Consequently, every generated trajectory is valid, delivering a \>10×\\timesimprovement in synthesis efficiency compared to rejection sampling, effectively making large\-scale agentic data synthesis computationally feasible\.

Table 2:Comparison of the average number of rollout attempts required to synthesize a single valid training sample\. "Roll out times" denotes the mean number of generation trials needed to produce one trajectory that passes the quality verification\.MethodNLPCVOthersOverallReject Sampling1491312Agentic\-Ideation1111
### 4\.4Ablation Study

Table[3](https://arxiv.org/html/2606.31229#S4.T3)investigates the individual contribution of each tool within our framework\. The results unequivocally demonstrate that removing any single tool leads to a consistent degradation in performance across all metrics\. This universal decline confirms the holistic nature of our Agentic Tool Space, where both external information acquisition \(e\.g\., retrieval tools\) and internal cognitive reasoning \(e\.g\., reflection and gap analysis\) are indispensable components\. The synergy between these tools ensures that the agent can effectively bridge the gap between raw data and high\-level scientific conceptualization\.

Table 3:Ablation Study on the contribution of individual tools within the Agentic Tool Space\.ToolsNov\.Sig\.Fea\.Overallw/o Search6\.037\.216\.045\.99w/o Get\_References6\.347\.295\.986\.32w/o Get\_Cited6\.577\.666\.076\.38w/o Analyse\_Gap5\.867\.265\.996\.07w/o Reflection6\.497\.346\.106\.43Full6\.747\.786\.126\.67A closer inspection reveals that the Search and Analyse\_Gap tools are particularly critical\. The exclusion of Search results in the lowest Overall score \(5\.99\), indicating that without the ability to actively query external databases for broad information, the agent becomes confined to the limited context of initial references, severely hampering its ability to verify facts and expand its knowledge boundary\. Similarly, removing Analyse\_Gap causes the most significant drop in the Novelty metric\. This highlights the tool’s pivotal role in the cognitive process; without explicitly synthesizing existing literature to pinpoint a "research void," the agent tends to generate ideas that are technically sound but incrementally trivial, failing to propose the distinct innovations that define high\-quality research\.

### 4\.5Human Study

To further validate the practical value and reliability of our method, we conducted a rigorous human evaluation\. We adopted a double\-blind protocol to eliminate potential bias\. Expert evaluators were presented with anonymized ideas generated by different models in a randomized order and were asked to score them based on four criteria: Novelty, Significance, Feasibility, and Overall quality\.

Table 4:Human evaluation results comparing Agentic\-Ideation against baselines\.MethodsNov\.Sig\.Fea\.OverallResearchAgent5\.836\.415\.415\.57SciPIP6\.026\.495\.575\.87Scimon6\.076\.685\.555\.76Virsci5\.826\.385\.435\.62Qwen3\-8B5\.966\.575\.425\.55Agentic\-Ideation6\.717\.506\.056\.45Improvement↑\\uparrow

10\.54%12\.28%8\.62%9\.88%Generated Research Trajectory for "Adaptive Latent Remasking"Thought:We’ve gathered initial papers, but I need to identify the common weaknesses across these approaches to pinpoint where the field is most vulnerable\.<Analyze\_Gap\>Standard diffusion frameworks involve repeated stochastic denoising, where small errors amplify\. A critical gap exists: models treat denoising as a fixed process without enabling dynamic correction of intermediate latent states…Thought:I have identified the gap\. Now I need to verify if recent works have bridged "self\-guidance" with "latent refinement\."<Get\_Cited\>Query: \["Guiding a Diffusion Model with a Bad Version of Itself", …\]<Result\>Found: \["Guiding a Diffusion Transformer with Internal Dynamics", …\]Thought:"Internal Dynamics" suggests self\-guidance is evolving\. Now I need to check if discrete remasking \(ReMDM\) has been extended to continuous spaces\.<Get\_Cited\>Query: "Remasking Discrete Diffusion Models"<Result\>Found: \["Corrective Diffusion Language Models"…\]Thought:"Corrective Diffusion" confirms post\-training correction is possible in NLP\. I should synthesize this with continuous latent spaces\.<Search\>Query: "Corrective Diffusion Language Models Abstract"<Result\>Abstract details: \[proposes a correction\-oriented post\-training principle…\]Thought:Converging evidence suggests explicit error\-correction is needed\. I will propose "Latent\-Space Remasking"\.<Ideation\>\(Draft 1\)Title:Latent\-Space Remasking\.Method:Using a learned policy to remask low\-confidence regions…Thought:I’ve synthesized a unified mechanism\. Now I must stress\-test it to ensure it doesn’t overlap with existing methods like RePaint\.<Reflection\>The core mechanism of simple remasking closely mirrors existing work like "RePaint"\.Decision:REJECT\. The idea lacks sufficient novelty\. A refinement distinguishing it from fixed priors is required\.Thought:The Critic is right\. The novelty should lie inadaptivelearning, utilizing internal error signals rather than fixed masks\.<Ideation\>\(Final\)Title:Adaptive Latent Refinement via Error\-Aware Remasking\.Method:We introduce a training method where the model learns a dynamic policy to identify and refine low\-confidence latent regions based on internal error signals from the denoising trajectory, enabling self\-driven correction without external conditioning\.Figure 4:A visualized research trajectory generated by Agentic\-Ideation\. The agent actively explores the literature, identifies a gap in error correction, and crucially, utilizes theReflectiontool to reject a redundant initial idea, leading to a more novel final proposal\.As shown in Table[4](https://arxiv.org/html/2606.31229#S4.T4), the human evaluation results align consistently with the automated metrics reported in the main experiment\. Agentic\-Ideation achieves superior performance across all dimensions, securing the highest Overall score of 6\.45, which surpasses the strongest baseline \(SciPIP\) by 9\.88%\. Notably, the most substantial improvement is observed in Significance \(\+12\.28%\), suggesting that human experts particularly value the logical depth and theoretical value derived from our agent’s grounded reasoning process\. Furthermore, the \+8\.62% gain in Feasibility confirms that the active usage of retrieval tools effectively reduces hallucinations, producing ideas that are not only innovative but also practically viable\.

To intuitively demonstrate the working mechanism of Agentic\-Ideation, we present a representative research trajectory in Figure[4](https://arxiv.org/html/2606.31229#S4.F4)\. In this case, the agent explores the domain of "Diffusion Models" to address the problem of error compounding\.

The trajectory illustrated in Figure[4](https://arxiv.org/html/2606.31229#S4.F4)offers a compelling validation of Agentic\-Ideation’s capabilities\. Unlike standard LLMs that often generate generic or hallucinated limitations, our agent leverages the<Analyze\_Gap\>tool to conduct a structural critique of diffusion models, identifying the specific theoretical void of inference\-time correction rather than superficial issues\. Throughout the process, the agent demonstrates strategic information seeking by actively linking distinct sub\-fields—tracing "Self\-Guidance" via<Get\_Cited\>and deep\-diving into "Corrective Diffusion" via<Search\>—to synthesize a hybrid hypothesis that bridges discrete text correction with continuous image generation\. Most crucially, the<Reflection\>step acts as a rigorous quality filter; when the agent detects that its initial "Latent\-Space Remasking" proposal lacks sufficient novelty compared to prior work like RePaint, it autonomously rejects the draft and iterates\. This self\-correction loop ensures that the final output, "Adaptive Error\-Aware Learning," is not only scientifically grounded but also distinctly innovative, demonstrating that our Agentic Tool Space serves as both a generative engine and an effective quality gatekeeper\.

## 5Conclusion

In this work, we address the rigidity of workflow\-based approaches and the inefficiency of agentic data synthesis for scientific ideation\. We introduce Agentic\-Ideation, an Oracle\-Guided framework that efficiently navigates the vast search space, bypassing the computational bottlenecks of naive exploration\. By training on these synthesized trajectories, our model acquires robust capabilities for grounded reasoning and autonomous exploration\. Empirical results confirm that Agentic\-Ideation establishes state\-of\-the\-art performance while boosting synthesis efficiency by over 10×\\times\.

## Impact Statements

This work significantly advances the field of automated scientific discovery by addressing the critical bottleneck of data scarcity\. By enabling the efficient synthesis of high\-quality agentic trajectories, our framework paves the way for developing autonomous AI scientists capable of grounded reasoning and reliable innovation\. This advancement holds the potential to accelerate the pace of research across diverse scientific disciplines, democratizing access to high\-level ideation capabilities and fostering human\-AI collaboration in solving complex scientific challenges\.

## References

- J\. Baek, S\. K\. Jauhar, S\. Cucerzan, and S\. J\. Hwang \(2024\)ResearchAgent: iterative research idea generation over scientific literature with large language models\.ArXivabs/2404\.07738\.External Links:[Link](https://api.semanticscholar.org/CorpusID:269042844)Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1),[1st item](https://arxiv.org/html/2606.31229#S4.I1.i1.p1.1.1)\.
- G\. Calic, N\. E\. Shamy, I\. Kinley, S\. Watter, and K\. Hassanein \(2020\)Subjective semantic surprise resulting from divided attention biases evaluations of an idea’s creativity\.Scientific Reports10\.External Links:[Link](https://api.semanticscholar.org/CorpusID:211054583)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p3.1)\.
- B\. Chen, C\. Shu, E\. Shareghi, N\. Collier, K\. Narasimhan, and S\. Yao \(2023\)FireAct: toward language agent fine\-tuning\.ArXivabs/2310\.05915\.External Links:[Link](https://api.semanticscholar.org/CorpusID:263829338)Cited by:[§3\.3](https://arxiv.org/html/2606.31229#S3.SS3.p2.1)\.
- M\. Chen, T\. Li, H\. Sun, Y\. Zhou, C\. Zhu, H\. Wang, J\. Z\. Pan, W\. Zhang, H\. Chen, F\. Yang, Z\. Zhou, and W\. Chen \(2025\)ReSearch: learning to reason with search for llms via reinforcement learning\.ArXivabs/2503\.19470\.External Links:[Link](https://api.semanticscholar.org/CorpusID:277313597)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p2.1)\.
- R\. Fang, S\. Cai, B\. Li, J\. Wu, G\. Li, W\. Yin, X\. Wang, X\. Wang, L\. Su, Z\. Zhang, S\. Wu, Z\. Tao, Y\. Jiang, P\. Xie, F\. Huang, and J\. Zhou \(2025\)Towards general agentic intelligence via environment scaling\.ArXivabs/2509\.13311\.External Links:[Link](https://api.semanticscholar.org/CorpusID:281325844)Cited by:[§2\.2](https://arxiv.org/html/2606.31229#S2.SS2.p1.1)\.
- X\. Geng, P\. Xia, Z\. Zhang, X\. Wang, Q\. Wang, R\. Ding, C\. Wang, J\. Wu, Y\. Zhao, K\. Li, Y\. Jiang, P\. Xie, F\. Huang, and J\. Zhou \(2025\)WebWatcher: breaking new frontier of vision\-language deep research agent\.ArXivabs/2508\.05748\.External Links:[Link](https://api.semanticscholar.org/CorpusID:280561766)Cited by:[§2\.2](https://arxiv.org/html/2606.31229#S2.SS2.p1.1)\.
- J\. Gottweis, W\. Weng, A\. Daryin, T\. Tu, A\. Palepu, P\. Sirkovic, A\. Myaskovsky, F\. Weissenberger, K\. Rong, R\. Tanno,et al\.\(2025\)Towards an ai co\-scientist\.arXiv preprint arXiv:2502\.18864\.Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1)\.
- S\. Hu, C\. Lu, and J\. Clune \(2024\)Automated design of agentic systems\.ArXivabs/2408\.08435\.External Links:[Link](https://api.semanticscholar.org/CorpusID:271892234)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p2.1)\.
- B\. Jin, H\. Zeng, Z\. Yue, D\. Wang, H\. Zamani, and J\. Han \(2025\)Search\-r1: training llms to reason and leverage search engines with reinforcement learning\.ArXivabs/2503\.09516\.External Links:[Link](https://api.semanticscholar.org/CorpusID:276937772)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p2.1),[§3\.3](https://arxiv.org/html/2606.31229#S3.SS3.p2.1)\.
- K\. Li, Z\. Zhang, H\. Yin, R\. Ye, Y\. Zhao, L\. Zhang, L\. Ou, D\. Zhang, X\. Wu, J\. Wu, X\. Wang, Z\. Qiao, Z\. Zhang, Y\. Jiang, P\. Xie, F\. Huang, and J\. Zhou \(2025a\)WebSailor\-v2: bridging the chasm to proprietary agents via synthetic data and scalable reinforcement learning\.ArXivabs/2509\.13305\.External Links:[Link](https://api.semanticscholar.org/CorpusID:281325776)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p3.1)\.
- K\. Li, Z\. Zhang, H\. Yin, L\. Zhang, L\. Ou, J\. Wu, W\. Yin, B\. Li, Z\. Tao, X\. Wang, W\. Shen, J\. Zhang, D\. Zhang, X\. Wu, Y\. Jiang, M\. Yan, P\. Xie, F\. Huang, and J\. Zhou \(2025b\)WebSailor: navigating super\-human reasoning for web agent\.ArXivabs/2507\.02592\.External Links:[Link](https://api.semanticscholar.org/CorpusID:280078605)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p3.1),[§2\.2](https://arxiv.org/html/2606.31229#S2.SS2.p1.1)\.
- L\. Li, W\. Xu, J\. Guo, R\. Zhao, X\. Li, Y\. Yuan, B\. Zhang, Y\. Jiang, Y\. Xin, R\. Dang,et al\.\(2024\)Chain of ideas: revolutionizing research via novel idea development with llm agents\.arXiv preprint arXiv:2410\.13185\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p2.1)\.
- X\. Liang, J\. Yang, Y\. Wang, C\. Tang, Z\. Zheng, S\. Song, Z\. Lin, Y\. Yang, S\. Niu, H\. Wang,et al\.\(2025\)Surveyx: academic survey automation via large language models\.arXiv preprint arXiv:2502\.14776\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- C\. Lu, C\. Lu, R\. T\. Lange, J\. Foerster, J\. Clune, and D\. Ha \(2024\)The ai scientist: towards fully automated open\-ended scientific discovery\.arXiv preprint arXiv:2408\.06292\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- A\. Novikov, N\. V˜u, M\. Eisenberger, E\. Dupont, P\. Huang, A\. Z\. Wagner, S\. Shirobokov, B\. M\. Kozlovskii, F\. J\. R\. Ruiz, A\. Mehrabian, M\. P\. Kumar, A\. See, S\. Chaudhuri, G\. Holland, A\. Davies, S\. Nowozin, P\. Kohli, M\. Balog, and G\. Deepmind \(2025\)AlphaEvolve: a coding agent for scientific and algorithmic discovery\.ArXivabs/2506\.13131\.External Links:[Link](https://api.semanticscholar.org/CorpusID:278658695)Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1)\.
- Y\. Pu, T\. Lin, and H\. Chen \(2025\)PiFlow: principle\-aware scientific discovery with multi\-agent collaboration\.arXiv preprint arXiv:2505\.15047\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- B\. Romera\-Paredes, M\. Barekatain, A\. Novikov, M\. Balog, M\. P\. Kumar, E\. Dupont, F\. J\. R\. Ruiz, J\. S\. Ellenberg, P\. Wang, O\. Fawzi, P\. Kohli, A\. Fawzi, J\. Grochow, A\. Lodi, J\. Mouret, T\. Ringer, and T\. Yu \(2023\)Mathematical discoveries from program search with large language models\.Nature625,pp\. 468 – 475\.External Links:[Link](https://api.semanticscholar.org/CorpusID:266223700)Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1)\.
- S\. Schmidgall and M\. Moor \(2025\)Agentrxiv: towards collaborative autonomous research\.arXiv preprint arXiv:2503\.18102\.Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1)\.
- S\. Schmidgall, Y\. Su, Z\. Wang, X\. Sun, J\. Wu, X\. Yu, J\. Liu, Z\. Liu, and E\. Barsoum \(2025\)Agent laboratory: using llm agents as research assistants\.arXiv preprint arXiv:2501\.04227\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- Y\. Shang, Y\. Li, K\. Zhao, L\. Ma, J\. Liu, F\. Xu, and Y\. Li \(2024\)AgentSquare: automatic llm agent search in modular design space\.ArXivabs/2410\.06153\.External Links:[Link](https://api.semanticscholar.org/CorpusID:273228108)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p2.1)\.
- H\. Su, R\. Chen, S\. Tang, Z\. Yin, X\. Zheng, J\. Li, B\. Qi, Q\. Wu, H\. Li, W\. Ouyang, P\. Torr, B\. Zhou, and N\. Dong \(2024\)Many heads are better than one: improved scientific idea generation by a llm\-based multi\-agent system\.InAnnual Meeting of the Association for Computational Linguistics,External Links:[Link](https://api.semanticscholar.org/CorpusID:273346445)Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1),[4th item](https://arxiv.org/html/2606.31229#S4.I1.i4.p1.1.1)\.
- J\. Tang, L\. Xia, Z\. Li, and C\. Huang \(2025\)AI\-researcher: autonomous scientific innovation\.arXiv preprint arXiv:2505\.18705\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- Z\. Tao, J\. Wu, W\. Yin, J\. Zhang, B\. Li, H\. Shen, K\. Li, L\. Zhang, X\. Wang, Y\. Jiang, P\. Xie, F\. Huang, and J\. Zhou \(2025\)WebShaper: agentically data synthesizing via information\-seeking formalization\.ArXivabs/2507\.15061\.External Links:[Link](https://api.semanticscholar.org/CorpusID:280271252)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p3.1)\.
- Q\. Wang, D\. Downey, H\. Ji, and T\. Hope \(2023\)SciMON: scientific inspiration machines optimized for novelty\.InAnnual Meeting of the Association for Computational Linguistics,External Links:[Link](https://api.semanticscholar.org/CorpusID:258841365)Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1),[3rd item](https://arxiv.org/html/2606.31229#S4.I1.i3.p1.1.1)\.
- W\. Wang, L\. Gu, L\. Zhang, Y\. Luo, Y\. Dai, C\. Shen, L\. Xie, B\. Lin, X\. He, and J\. Ye \(2024a\)SciPIP: an llm\-based scientific paper idea proposer\.ArXivabs/2410\.23166\.External Links:[Link](https://api.semanticscholar.org/CorpusID:273695165)Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1),[2nd item](https://arxiv.org/html/2606.31229#S4.I1.i2.p1.1.1)\.
- Y\. Wang, Q\. Guo, W\. Yao, H\. Zhang, X\. Zhang, Z\. Wu, M\. Zhang, X\. Dai, Q\. Wen, W\. Ye,et al\.\(2024b\)Autosurvey: large language models can automatically write surveys\.Advances in neural information processing systems37,pp\. 115119–115145\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- J\. Wu, B\. Li, R\. Fang, W\. Yin, L\. Zhang, Z\. Tao, D\. Zhang, Z\. Xi, Y\. Jiang, P\. Xie, F\. Huang, and J\. Zhou \(2025\)WebDancer: towards autonomous information seeking agency\.ArXivabs/2505\.22648\.External Links:[Link](https://api.semanticscholar.org/CorpusID:278959248)Cited by:[§2\.2](https://arxiv.org/html/2606.31229#S2.SS2.p1.1)\.
- Y\. Yamada, R\. T\. Lange, C\. Lu, S\. Hu, C\. Lu, J\. Foerster, J\. Clune, and D\. Ha \(2025\)The ai scientist\-v2: workshop\-level automated scientific discovery via agentic tree search\.arXiv preprint arXiv:2504\.08066\.Cited by:[§2\.1](https://arxiv.org/html/2606.31229#S2.SS1.p1.1)\.
- X\. Yan, S\. Feng, J\. Yuan, R\. Xia, B\. Wang, L\. Bai, and B\. Zhang \(2025\)Surveyforge: on the outline heuristics, memory\-driven generation, and multi\-dimensional evaluation for automated survey writing\.InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 12444–12465\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- A\. Yang, A\. Li, B\. Yang, B\. Zhang, B\. Hui, B\. Zheng, B\. Yu, C\. Gao, C\. Huang, C\. Lv, C\. Zheng, D\. Liu, F\. Zhou, F\. Huang, F\. Hu, H\. Ge, H\. Wei, H\. Lin, J\. Tang, J\. Yang, J\. Tu, J\. Zhang, J\. Yang, J\. Yang, J\. Zhou, J\. Zhou, J\. Lin, K\. Dang, K\. Bao, K\. Yang, L\. Yu, L\. Deng, M\. Li, M\. Xue, M\. Li, P\. Zhang, P\. Wang, Q\. Zhu, R\. Men, R\. Gao, S\. Liu, S\. Luo, T\. Li, T\. Tang, W\. Yin, X\. Ren, X\. Wang, X\. Zhang, X\. Ren, Y\. Fan, Y\. Su, Y\. Zhang, Y\. Zhang, Y\. Wan, Y\. Liu, Z\. Wang, Z\. Cui, Z\. Zhang, Z\. Zhou, and Z\. Qiu \(2025\)Qwen3 technical report\.ArXivabs/2505\.09388\.External Links:[Link](https://api.semanticscholar.org/CorpusID:278602855)Cited by:[5th item](https://arxiv.org/html/2606.31229#S4.I1.i5.p1.1.1),[§4\.1](https://arxiv.org/html/2606.31229#S4.SS1.p7.1)\.
- H\. Yu, Z\. Hong, Z\. Cheng, K\. Zhu, K\. Xuan, J\. Yao, T\. Feng, and J\. You \(2024\)Researchtown: simulator of human research community\.arXiv preprint arXiv:2412\.17767\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p1.1)\.
- L\. Zhang, M\. Wang, and B\. Chen \(2025a\)Scientific judgment drifts over time in ai ideation\.ArXivabs/2511\.04964\.External Links:[Link](https://api.semanticscholar.org/CorpusID:282889781)Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p3.1)\.
- Y\. Zhang, Y\. Yang, J\. Shu, X\. Wen, and J\. Sang \(2025b\)Agent models: internalizing chain\-of\-action generation into reasoning models\.ArXivabs/2503\.06580\.External Links:[Link](https://api.semanticscholar.org/CorpusID:276902792)Cited by:[§3\.3](https://arxiv.org/html/2606.31229#S3.SS3.p2.1)\.
- J\. Zhou, R\. Zhu, M\. Chen, J\. Wang, and K\. Wang \(2025\)TrustResearcher: automating knowledge\-grounded and transparent research ideation with multi\-agent collaboration\.arXiv preprint arXiv:2510\.20844\.Cited by:[§1](https://arxiv.org/html/2606.31229#S1.p2.1)\.

## Appendix AAppendix

### A\.1More Details of Evaluation Metrics

To ensure a rigorous and consistent assessment of the generated research ideas, we employ a standardized scoring rubric ranging from 1 to 10 across four key dimensions: Novelty, Significance, Feasibility, and Overall Score\. Both the automated LLM judges and human evaluators adhere to the detailed criteria outlined below\.

Novelty \(1\-10\)Evaluates the innovation of the proposed method\.

- •9\-10 \(Groundbreaking\):Proposes a completely new paradigm, mathematical formulation, or solves a long\-standing open problem in a unique way\.
- •7\-8 \(Significant\):Introduces a clever variation or a non\-obvious combination of existing techniques that offers substantial new insights\.
- •5\-6 \(Incremental\):Represents a standard application of known methods to a new domain or offers only minor improvements\.
- •1\-4 \(Trivial\):Lacks originality; constitutes derivative work or merely repeats a known solution\.

Significance \(1\-10\)Evaluates the potential impact and importance of the addressed problem\.

- •9\-10 \(High Impact\):Addresses a critical bottleneck in the field; results would likely influence future research directions\.
- •7\-8 \(Important\):Solves a meaningful problem within a specific subfield; highly relevant to the community\.
- •5\-6 \(Moderate\):The problem is valid but niche or of limited interest to the broader community\.
- •1\-4 \(Low\):The problem is unimportant, contrived, or already well\-solved\.

Feasibility \(1\-10\)Evaluates the technical soundness and likelihood of success\.

- •9\-10 \(Very High\):The methodology is rigorous, assumptions are clearly valid, and the proposed steps are logical and fully implementable\.
- •7\-8 \(High\):The approach is sound, though some minor implementation details might need further clarification\.
- •5\-6 \(Uncertain\):There are theoretical gaps or risky assumptions that might lead to failure\.
- •1\-4 \(Low\):Fundamentally flawed; the method contradicts established principles or is impossible to implement\.

Overall Score \(1\-10\)A holistic assessment of the idea’s quality\.

- •9\-10 \(Excellent\):An outstanding idea with clear potential to become a seminal work\. Extremely promising\.
- •7\-8 \(Good\):A strong, solid idea that is well\-conceived and worth pursuing\.
- •5\-6 \(Fair\):Has some merit but contains significant flaws, gaps, or lack of depth that need to be addressed\.
- •1\-4 \(Poor\):Critically flawed, lacks substance, or is not ready for serious consideration\.

### A\.2Compute Sources

All experiments were conducted on a high\-performance computing cluster\. Table[5](https://arxiv.org/html/2606.31229#A1.T5)summarizes the detailed computing resources, data statistics, and training hyperparameters used for fine\-tuning the Agentic LLM\.

Table 5:Implementation Details and Hyperparameters\.The model was fully fine\-tuned on the synthesized trajectory dataset\.ConfigurationValueCompute & DataComputing Infrastructure4×\\timesNVIDIA A100 \(80GB\)Backbone ModelQwen3\-8BTuning StrategyFull Fine\-TuningTraining Data Size4,646 TrajectoriesTotal Training Time∼\\sim10\.5 HoursTraining ParametersNumber of Epochs5Initial Learning Rate5e\-5LR Scheduler TypeCosine
### A\.3Limitations

Despite the promising results, we acknowledge two primary limitations\. First, our experiments rely on the Qwen3\-8B backbone; while efficient, its reasoning depth and world knowledge are naturally constrained compared to larger\-scale foundation models, suggesting that scaling up could further enhance idea complexity\. Second, the current agentic tool space is predominantly retrieval\-oriented, focusing on information acquisition rather than executable actions\. Future work should integrate "active" tools, such as Python code execution or domain\-specific simulators, to allow the agent to perform preliminary validation of its proposed ideas\.