EnvLunch: The Environment as a Free Lunch for Learning to Interact

Hugging Face Daily Papers Papers

Summary

EnvLunch 提出一种无标注的热身训练阶段,通过从可执行环境中采样并执行动作轨迹,让智能体根据最终观测恢复等价轨迹,从而在无需人工标注的情况下提升下游智能体强化学习性能,显著减少所需标注数据量。

For agentic data analysis, language-model agents often require a large number of annotated tasks to learn how to interact effectively with executable environments (i.e., databases). While high-quality annotated tasks require heavy manual effort, an executable environment already provides rich interaction structure and verifiable outcomes. In this sense, the environment itself offers a free lunch, an additional set of verifiable tasks that require no human annotation. We propose EnvLunch, a warm-up stage that turns this environmental signal into agent training without human-written or model-generated task descriptions, before downstream agentic reinforcement learning. EnvLunch samples valid action trajectories, executes them to obtain final observations, and trains an agent to recover a functionally equivalent trajectory given only its final observation. This label-free warm-up enables the model to outperform the baseline by over 9 points on average across all downstream training budgets, and with few labels, the baseline needs 8 to 32 times as many annotated examples to match the accuracy that the EnvLunch model reaches at its smallest training budget. Letting the environment alone define the task yields a larger gain than having the model write its own tasks over the same environments, and this warm-up also improves fine-tuning on benchmarks beyond data analysis. EnvLunch therefore saves annotated tasks and provides a better starting point for fine-tuning agentic models when such tasks are limited.
Original Article
View Cached Full Text

Cached at: 10/28/26, 01:53 AM

Paper page - EnvLunch: The Environment as a Free Lunch for Learning to Interact

Source: https://huggingface.co/papers/2610.33817 Published on Oct 24

·

Submitted byhttps://huggingface.co/thinkwee

weiliuon Oct 27

Abstract

EnvLunch leverages executable environments to generate verifiable training trajectories without human annotations, improving agent performance and reducing labeled data requirements for downstream tasks.

For agentic data analysis, language-model agents often require a large number of annotated tasks to learn how to interact effectively withexecutable environments(i.e., databases). While high-quality annotated tasks require heavy manual effort, an executable environment already provides rich interaction structure andverifiable outcomes. In this sense, the environment itself offers a free lunch, an additional set of verifiable tasks that require no human annotation. We propose EnvLunch, a warm-up stage that turns this environmental signal into agent training without human-written or model-generated task descriptions, before downstreamagentic reinforcement learning. EnvLunch samples validaction trajectories, executes them to obtain final observations, and trains an agent to recover a functionally equivalent trajectory given only its final observation. Thislabel-free warm-upenables the model to outperform the baseline by over 9 points on average across all downstream training budgets, and with few labels, the baseline needs 8 to 32 times as many annotated examples to match the accuracy that the EnvLunch model reaches at its smallest training budget. Letting the environment alone define the task yields a larger gain than having the model write its own tasks over the same environments, and this warm-up also improves fine-tuning on benchmarks beyond data analysis. EnvLunch therefore saves annotated tasks and provides a better starting point for fine-tuning agentic models when such tasks are limited.

View arXiv pageView PDFGitHub0Add to collection

Get this paper in your agent:

hf papers read 2610\.33817

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.33817 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.33817 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2610.33817 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

EAU: Environment-Agent-User Co-evolution for Training User-Centric Agents

Hugging Face Daily Papers

EAU 是一个元智能体框架,在训练多轮 LLM 智能体时协同演化用户模拟器、环境与强化学习配置,使训练系统随策略一同进化。在三个交互式智能体基准上,EAU 比最强基线整体提升 14.7–15.0%,在 ColBench 上任务完成率最高提升 36.7%。