Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs
Summary
Deliberate Evolution (DE) is an agentic framework that improves LLM-based symbolic regression by decoupling candidate generation from search control, using adaptive operators, structural diagnosis tools, and reflective memory to achieve better results with only 40% of the standard sample budget.
View Cached Full Text
Cached at: 06/05/26, 02:13 AM
# Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs Source: [https://arxiv.org/abs/2606.04360](https://arxiv.org/abs/2606.04360) [View PDF](https://arxiv.org/pdf/2606.04360) > Abstract:Symbolic regression \(SR\) discovers compact mathematical expressions from data, yet recent LLM\-based evolutionary methods remain sample\-inefficient because they rely mainly on scalar feedback such as MSE\. We identify a core limitation: existing methods conflate candidate proposal with search guidance, requiring the LLM to infer how to evolve an expression, diagnose its errors, and reuse past experience from a single score\. To address this, we propose Deliberate Evolution \(DE\), an agentic framework that decouples symbolic generation from search control\. DE guides LLM proposals with adaptive operators for search direction, analytical tools for structural diagnosis, and reflective memory for trajectory\-level experience\. Experiments on LLM\-SRBench show that DE consistently outperforms representative LLM\-based SR baselines across diverse scientific domains while using only 40% of the standard sample budget\. ## Submission history From: Xinyu Pang \[[view email](https://arxiv.org/show-email/4ae232aa/2606.04360)\] **\[v1\]**Wed, 3 Jun 2026 02:22:16 UTC \(4,845 KB\)
Similar Articles
Hyper-ES: Effective Evolution Strategies for LLM Reasoning via Descent Direction Merging
This paper proposes Hyper-ES, a subspace-based evolution strategy framework for LLM reasoning that obtains descent directions via lightweight gradient-based fine-tuning and then uses CMA-ES to merge layer-wise DARE-TIES coefficients, consistently outperforming GRPO-LoRA while requiring fewer gradient updates.
@Kevin_GuoweiXu: How should LLMs sample on hard reasoning problems during post-training and inference where direct rollouts rarely produ…
Introduces BES (Bidirectional Evolutionary Search), a search framework for LLMs that combines forward candidate evolution with backward goal decomposition to improve sampling on hard reasoning problems during post-training and inference.
Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO
This paper investigates Evolution Strategies (ES) as a post-training paradigm for LLM reasoning, showing that ES provides broader reasoning coverage and better Pass@K performance than GRPO through sparse functional updates and population diversity.
AlgoEvolve: LLM-driven Meta-evolution of Algorithmic Trading Programs
Introduces AlgoEvolve, an LLM-driven evolutionary framework that generates and iteratively improves algorithmic trading strategies, with a meta-evolutionary outer loop that evolves prompts to guide the inner loop synthesis.
EvoMD-LLM: Learning the Language of Species Evolution in Reactive Molecular Dynamics
EvoMD-LLM reformulates reactive molecular dynamics trajectories as symbolic temporal sequences, enabling LLMs to model species evolution over time through fine-tuning and temporal scaffolding, achieving up to 66.14% accuracy and interpretable predictions.