EnvLunch: The Environment as a Free Lunch for Learning to Interact
Summary
EnvLunch 提出一种无标注的热身训练阶段,通过从可执行环境中采样并执行动作轨迹,让智能体根据最终观测恢复等价轨迹,从而在无需人工标注的情况下提升下游智能体强化学习性能,显著减少所需标注数据量。
View Cached Full Text
Cached at: 10/28/26, 01:53 AM
Paper page - EnvLunch: The Environment as a Free Lunch for Learning to Interact
Source: https://huggingface.co/papers/2610.33817 Published on Oct 24
·
Submitted byhttps://huggingface.co/thinkwee
weiliuon Oct 27
Abstract
EnvLunch leverages executable environments to generate verifiable training trajectories without human annotations, improving agent performance and reducing labeled data requirements for downstream tasks.
For agentic data analysis, language-model agents often require a large number of annotated tasks to learn how to interact effectively withexecutable environments(i.e., databases). While high-quality annotated tasks require heavy manual effort, an executable environment already provides rich interaction structure andverifiable outcomes. In this sense, the environment itself offers a free lunch, an additional set of verifiable tasks that require no human annotation. We propose EnvLunch, a warm-up stage that turns this environmental signal into agent training without human-written or model-generated task descriptions, before downstreamagentic reinforcement learning. EnvLunch samples validaction trajectories, executes them to obtain final observations, and trains an agent to recover a functionally equivalent trajectory given only its final observation. Thislabel-free warm-upenables the model to outperform the baseline by over 9 points on average across all downstream training budgets, and with few labels, the baseline needs 8 to 32 times as many annotated examples to match the accuracy that the EnvLunch model reaches at its smallest training budget. Letting the environment alone define the task yields a larger gain than having the model write its own tasks over the same environments, and this warm-up also improves fine-tuning on benchmarks beyond data analysis. EnvLunch therefore saves annotated tasks and provides a better starting point for fine-tuning agentic models when such tasks are limited.
View arXiv pageView PDFGitHub0Add to collection
Get this paper in your agent:
hf papers read 2610\.33817
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2610.33817 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2610.33817 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2610.33817 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
CoworkEnv: Synthesizing Training Environments for Long-Horizon Cowork Agents
CoworkEnv 提出一个能力引导框架,为 AI 同事智能体合成可执行的训练环境,通过工作流引导的任务构建与程序化验证,支持 SFT 与 RL 训练紧凑的 PocketWorker 模型,在 Claw-Eval 多轮任务上取得显著提升。
EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents
本文提出EmbodiedCLBench,首个用于评估自进化智能体持续学习能力的具身仿真基准,采用组合泛化为核心评估原则。实验结果显示当前智能体虽能从基础任务经验中获益,但改进程度无法随学习样本数量有效扩展。
@browser_use: Introducing rl-env-use: RL environments for anyone, in any domain. Describe a skill in one line. Get a verified environ…
Browser Use 宣布开源 rl-env-use:只需一行描述技能,即可自动生成基于真实案例的、经过验证的强化学习环境,适用于任意领域,可用于模型优化训练。
EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL
EnvFactory automates the creation of executable tool environments and natural multi-turn trajectories for training LLMs with agentic reinforcement learning, achieving superior performance on benchmarks like BFCLv3 and MCP-Atlas with fewer environments than prior work.
EAU: Environment-Agent-User Co-evolution for Training User-Centric Agents
EAU 是一个元智能体框架,在训练多轮 LLM 智能体时协同演化用户模拟器、环境与强化学习配置,使训练系统随策略一同进化。在三个交互式智能体基准上,EAU 比最强基线整体提升 14.7–15.0%,在 ColBench 上任务完成率最高提升 36.7%。