SEAL: Synergistic Co-Evolution of Agents and Learning Environments
Summary
SEAL is a closed-loop co-evolution framework for interactive tool-use agents that addresses Agent-Environment Misalignment by synchronizing policy and environment updates using on-policy trajectories and turn-level diagnosis.
View Cached Full Text
Cached at: 05/26/26, 06:42 AM
Paper page - SEAL: Synergistic Co-Evolution of Agents and Learning Environments
Source: https://huggingface.co/papers/2605.24426 Large Language Model agents are increasingly improved through interaction rather than static supervision. Yet most self-evolution methods adapt either the policy or the learning environment in isolation. As the agent’s capability frontier shifts during training, the environment that provides supervision often remains static or only weakly coupled to the agent’s revealed failures. We call this mismatch Agent-Environment Misalignment.
SEAL is a closed-loop co-evolution framework for interactive tool-use agents. It collects on-policy trajectories under executable verification, diagnoses failed rollouts into turn-level labels, and uses these diagnoses as a shared signal for both learning-interface evolution and model-side policy optimization. With only 400 training samples, SEAL yields +8.25 to +26.25 average-point gains across three backbones and exhibits positive out-of-distribution transfer.
Similar Articles
SEAL: Synergistic Co-Evolution of Agents and Learning Environments
SEAL proposes a closed-loop framework for jointly evolving LLM agents and their training environments, using diagnosis-guided labels to align both sides. It achieves substantial gains in multi-turn tool-use tasks with only 400 training samples, demonstrating improved robustness and out-of-distribution transfer.
SEAGym: An Evaluation Environment for Self-Evolving LLM Agents
SEAGym is a new evaluation environment for self-evolving LLM agents that measures agent harness updates across training, validation, test, replay, and cost records, providing complementary signals about the evolution process.
Self-Evolving Agents with Anytime-Valid Certificates
This paper introduces SEA, an architecture for self-evolving agents that confines self-modification to a steering adapter and versioned harness around a frozen base model, using anytime-valid gates to audit modifications against a fixed error budget. Experiments on SWE-bench Verified with four base models show that the suite provides a +4 to +5% improvement on strong base models while preventing regressions.
SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
Proposes SEED, a self-evolving on-policy distillation framework that converts completed trajectories into hindsight skills to improve reinforcement learning for interactive agent tasks, achieving consistent performance gains and sample efficiency.
Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember
This paper introduces SESA, a self-evolving skill-augmented search agent that co-evolves task generation and skill memory via tool-augmented search self-play. It improves accuracy across seven QA benchmarks over baselines while supporting memory-free deployment.