@Xudong07452910: 最近看 Agent 自进化相关的工作,我一直比较关注一个问题: Agent 留下来的 trajectory,到底什么时候才值得被下一轮训练继续学习? 这次我拿 SEED 的一篇 self-evolving Agent 论文,丢进 Apod…
摘要
这篇文章探讨了AI代理自进化中轨迹学习的重要性,并介绍了Apodex 1.1系统和开源工具FrontierAgent,用于执行和评估长时间的研究任务。
查看缓存全文
缓存时间: 2026/08/27 07:41
最近看 Agent 自进化相关的工作,我一直比较关注一个问题:
Agent 留下来的 trajectory,到底什么时候才值得被下一轮训练继续学习?
这次我拿 SEED 的一篇 self-evolving Agent 论文,丢进 Apodex 1.1 完整跑了一次。
一开始,我让它拆解论文的方法、实验和关键 claim,并把结论对应到具体的 Figure / Table / evidence。
任务已经跑了一段之后,我又中途加了一条要求:
重点检查「错误 trajectory 会不会被总结成错误的 hindsight skill,再在后续训练中被持续强化」,同时保留前面已经完成的研究结果。
整个过程我录了下来。
我比较感兴趣的,其实就是任务发生变化之后,Agent 怎么继续维护一条已经跑起来的长任务。
Apodex 1.1 这次把 Agent 的「能力单位」定义得比较完整:
从理解目标,到真正进入文件、搜索和代码环境执行;过程中维护任务状态、接收新的反馈,根据变化继续调整,最后交付的结论还要能够被重新核查。
背后对应的是一套异步 Agent Team。不同 Subagent 可以并行推进,阶段性结果持续回到 Shared Task State,用户也可以在任务执行过程中继续介入。
放到 Agent 自进化里看,这一层其实很重要。
trajectory learning、reflection、skill learning 最后都依赖执行过程中留下来的经验。如果任务状态、证据来源和失败分支本身都不稳定,后面拿这些 trajectory 继续训练,很容易把噪声一起学进去。
Apodex 还把这条线继续延伸到了 AI4AI:用自动化流程把出题、trajectory 筛选、训练、评测和反思串起来。
官方实验里,他们用这套流程训练 Qwen3.5-0.8B,经过 10 轮自动迭代,评测总分从 51.0% 提升到了 56.0%。
所以这次体验下来,我更关注的是一个基础问题:
Agent 怎么留下足够可靠、可追踪、可验证的执行过程,让这些经验之后真的能够被重新利用。
相关的模型和框架也都开放出来了:
FrontierAgent 是开源的 Agent harness,支持 ReAct / Agent Team。做 Agent 的可以去 GitHub 看看: https://github.com/ApodexAI/FrontierAgent…
Apodex 1.1 mini(35B)权重也已经放到 Hugging Face,可以本地部署,并和 FrontierAgent 搭配: https://huggingface.co/collections/apodex/apodex-11…
完整的 Apodex 1.1 workbench 已经上线。最直接的体验方式,就是丢一篇自己真的在看的 paper、一份数据或者代码进去,再在任务跑到一半时改一次要求,看看它怎么继续把任务跑下去: https://apodex.ai
ApodexAI/FrontierAgent
Source: https://github.com/ApodexAI/FrontierAgent
FrontierAgent
FrontierAgent is an open-source agent runtime, terminal product, and evaluation
suite for long-horizon research and file-based work. The frontier-agent TUI
ships two native workflows:
- ReAct — one stateful agent researches, reads files, writes deliverables, runs commands, and iterates in a task-scoped sandbox.
- Agent Team — a coordinator maintains a task board, delegates independent work to parallel sub-agents, collects their reports, and synthesizes the result.
The same workflow engine powers the benchmark runner used to evaluate Apodex models. The framework, tools, workflows, and evaluation layer remain separate, so each can be reused independently.
Want to try FrontierAgent without hosting a model?
Apodex-1.1 is available through the Apodex API Platform. Get an API key, connect its OpenAI-compatible endpoint, and start running FrontierAgent in minutes.
New here? Use the documentation index to find the right installation, SGLang, workflow, evaluation, or developer guide.
Highlights
- Native Agent Team workflow. The coordinator decomposes the request, dispatches bounded parallel assignments, receives structured reports, and can use an optional fast reporter for final evidence review.
- Task Board. Agent Team’s
add_taskandupdate_taskevents appear live in the TUI sidebar with pending, active, completed, blocked, and cancelled state. - Sandboxed file work. Shell and file tools share one task-scoped filesystem:
/inputsis read-only,/workspaceis working state, and/outputscontains persistent deliverables. Authorization and sandbox failures are fail-closed. - Asynchronous intervention. Type while an agent is running to queue a new instruction. It is injected at the next safe turn boundary without discarding the active run. In Agent Team mode it steers the coordinator; already-running sub-agents are allowed to finish.
- Transparent deliverables. On macOS/Docker,
/outputsmaps to.apodex/runs/<session-id>/outputson the host. The same run directory also contains its checkpoint, trace, engine log, and trajectories. - Approval, trace, and recovery. Mutating operations show a diff and require
approval unless
--yesis enabled. Sessions are checkpointed, every action is traced locally,/revertrestores session changes, and--resumecontinues a saved run. - Evaluation included. The subprocess runner supports research and file-grounded benchmarks, deterministic artifact collection, concurrency, progress inspection, and rerunning individual failures.
Conceptual Agent Team workflow, from task delegation and asynchronous report collection to verification and final synthesis.
How it fits together
flowchart LR
U["User / benchmark task"] --> TUI["TUI or subprocess runner"]
TUI --> R["Stateful ReAct"]
TUI --> C["Agent Team coordinator"]
C --> B["Task board"]
B --> S1["Sub-agent 1"]
B --> S2["Sub-agent 2"]
B --> SN["Sub-agent N"]
R --> FS["Task sandbox"]
S1 --> FS
S2 --> FS
SN --> FS
FS --> I["/inputs (read-only)"]
FS --> W["/workspace (working files)"]
FS --> O["/outputs (deliverables)"]
S1 --> C
S2 --> C
SN --> C
C --> A["Final answer / report"]
R --> A
The repository boundaries are intentional:
frontier_agent/ generic loop, scheduling, registries, AgentBus, observers
plugins/tools/ web, shell, file, sandbox, and team tool implementations
workflows/ ReAct and Agent Team pipelines, profiles, prompts, observers
apodex/ terminal CLI/TUI, approvals, sessions, traces, and Docker path
benchmarks/ public harness plus bundled FrontierSearchBench/FrontierChallenge
More detail: framework architecture, Agent Team, and Stateful ReAct. See run artifacts and timestamps for the on-disk layout.
Quick start
Requirements: Git, Python 3.12, uv, and an OpenAI-compatible model endpoint. Docker is optional.
git clone https://github.com/ApodexAI/FrontierAgent.git
cd FrontierAgent
uv sync --python 3.12 --extra dev
cp .env.example .env
Add your endpoint to .env:
OPENAI_API_KEY=your-key
OPENAI_BASE_URL=https://your-openai-compatible-endpoint/v1
OPENAI_MODEL=your-model-name
# Optional web research tools
SERPER_API_KEY=
JINA_API_KEY=
Start the TUI:
# Stateful single-agent workflow
uv run frontier-agent --mode react --cwd /path/to/project
# Coordinator plus parallel sub-agents
uv run frontier-agent --mode agent_team --cwd /path/to/project
uv sync above installs the lightweight terminal runtime. Scientific and
document packages are intentionally optional in native mode; the agent installs
only what a task actually needs into <project>/.apodex/runtime/native. The
apodex command is retained as a compatibility alias.
Prefer a script that does all of the above? ./scripts/run-macos.sh and
./scripts/run-linux.sh set up a hosted-endpoint install, and
./scripts/run-linux-gpu.sh --install-system-deps --setup-only prepares a native,
isolated SGLang environment on a Linux NVIDIA GPU. The step-by-step equivalent is
the endpoint quickstart
(中文教程), which requires neither
model self-hosting nor Docker.
Local SGLang serving is pinned to reviewed NVIDIA driver / CUDA / SGLang tracks,
and a mismatch surfaces late as opaque CUDA or Triton kernel errors during model
load. Confirm your nvidia-smi driver against the
GPU compatibility matrix before choosing an
image tag or native pin. The GPU helper selects a reviewed userspace track from
the host driver, but never installs or replaces the driver itself.
Deployment model
The operating system, FrontierAgent runtime, and model runtime are independent choices. “NVIDIA” describes the local model service, not how the agent itself runs. Unsure which applies to your machine or GPU provider? Start with the installation chooser.
| Environment | FrontierAgent runtime | Model endpoint | Start here |
|---|---|---|---|
| macOS | native or Docker Desktop | hosted or another OpenAI-compatible endpoint | macOS |
| Linux host/VM | native (default), bubblewrap, or Docker | hosted, native SGLang, or Docker SGLang | Linux |
| managed Linux GPU container | native inside the provider container | custom GPU image or native SGLang | GPU platforms |
| Windows | WSL2, treated as Linux | hosted or a WSL2-reachable endpoint | Linux/WSL2 |
Chinese-speaking macOS users can use the macOS 中文安装与一键启动指南.
Containers and local models
Pre-built linux/amd64 and linux/arm64 images are published to the GitHub
Container Registry, so no local Python environment is needed:
cp .env.example .env
docker compose run --rm agent
- Run FrontierAgent in Docker — Compose, image
pinning, direct
docker run, and EC2/ECS deployment. - Docker SGLang on a Linux NVIDIA host — two containers on one network; SGLang owns the GPU.
- Native SGLang without nested Docker — for managed GPU environments that forbid a nested daemon.
- SGLang configuration reference — every
.env.sglangvariable, token-budget invariants, and tuning order. Production 35B templates for RTX 4090, RTX 5090, and two-GPU hosts live underconfig/sglang/.
Using the TUI
Run without a task for an interactive session, or pass one and stay in the session for follow-ups:
uv run frontier-agent --mode agent_team --cwd /repo \
"Research the alternatives, verify the evidence, and write a report"
# One-shot, line mode, or resume a saved session
uv run frontier-agent --mode react --cwd /repo -p "explain src/main.py"
uv run frontier-agent --mode agent_team --no-tui "compare these implementations"
uv run frontier-agent --resume
# Attach read-only documents before the TUI starts (repeatable)
uv run frontier-agent --mode react --cwd /repo \
--input ~/Downloads/claim.pdf --input ~/Desktop/photo.jpg
The sidebar carries the plan/task board, live tool activity, deliverables, and a session-scoped diff. While a workflow is busy, typing a follow-up queues it for the next safe turn boundary rather than interrupting the run.
For the four sidebar tabs, previews, approvals, attachments, clipboard support,
keys, and Agent Team live steering, see the
TUI user guide
(中文使用教程). The full slash-command, option,
and theming reference is apodex/README.md.
Workflow modes
| Mode | Best for | Execution model |
|---|---|---|
react | focused research, repository analysis, document/file work | one stateful agent using the tui workflow profile |
agent_team | broad questions that benefit from decomposition and parallel investigation | coordinator, persistent task board, bounded parallel sub-agents, report collection, synthesis |
Agent Team parallelism is additional to benchmark concurrency. When evaluating,
start with --concurrency 1; total simultaneous model calls can approach runner
concurrency multiplied by the team spawn limit.
Set SWARM_NO_WEB=1 to disable Agent Team web tools or REACT_NO_WEB=1 for
closed-book ReAct tasks.
Filesystem and security model
| Path | Policy | Purpose |
|---|---|---|
/inputs | read-only | supplied documents and benchmark inputs |
/workspace | read-write | source checkout, extracted data, scratch work |
/outputs | controlled read-write | final persistent deliverables |
File and shell tools share this one task sandbox and path policy. Interactive
sessions add an approval gate on writes, deletion, package installation, and
risky shell commands; some operations stay denied even with --yes; and file
mutations are journaled so /revert can undo them.
Details: sandboxing and path policy, approval and trace behavior, and the security policy.
Development
uv sync --frozen --extra sandbox --extra document-readers --extra eval --extra dev
uv run pytest -q
uv run ruff check .
See CONTRIBUTING.md for the full development environment, pre-flight checks, session debugging, and submission process. Building the container image is covered in Run FrontierAgent in Docker.
Benchmark evaluation
The evaluation harness runs each benchmark question in an isolated subprocess, supports resumable multi-run experiments, and dispatches benchmark-specific deterministic or model-based judges. A minimal smoke run, once the datasets are downloaded per the evaluation guide, is:
uv sync --extra eval --extra sandbox --extra document-readers
uv run python -m benchmarks.public.runner.run_subprocess \
--benchmark browsecomp --pipeline stateful-react-agent --profile default \
--limit 1 --concurrency 1 --out ./results/smoke
The evaluation guide is the canonical operator reference for credentials, judge preflight, datasets, file benchmarks, execution, and result inspection. The benchmark registry lists dataset keys, default pipelines, scoring implementations, and extension points. FrontierSearchBench has its own external scorer and an isolation requirement, so it is documented separately in FrontierSearchBench evaluation.
Supported benchmarks
BrowseComp, BrowseComp-ZH, xbench-DeepResearch, Humanity’s Last Exam (text-only), SuperChem, FrontierScience-Research, FrontierScience-Olympiad, DeepSearchQA, WideSearch, FrontierSearchBench, OfficeQA, GDPval, APEX, and OneMillion-Bench.
GDPval uses deterministic deliverable validation in this open-source harness; the agentic pairwise grader is intentionally excluded. The benchmark registry is authoritative for each dataset key, its default pipeline, and its scoring implementation.
Apodex-1.1 performance
The chart above compares the two FrontierAgent workflows with the Apodex-1.0 baseline and selected external systems. The Apodex results are summarized here:
| Configuration | APEX-Agents | GDPval | FrontierFinance | FrontierScience-Research | BioMysteryBench | HLE |
|---|---|---|---|---|---|---|
| Apodex-1.1 Agent Team | 38.5 | 78.8 | 54.3 | 63.3 | 35.3 | 56.1 |
| Apodex-1.1 ReAct | 34.4 | 69.5 | 48.7 | 55.0 | 23.5 | 53.2 |
| Apodex-1.0 | 16.5 | 59.3 | 40.3 | 28.3 | 17.6 | 49.0 |
Earlier Apodex-1.0 checkpoints remain available in the Hugging Face collection, with model cards and serving guidance.
Citation
Cite the current release:
@article{apodex11,
title = {Apodex-1.1: Scaling Agentic Intelligence for Complex Work},
author = {Apodex Team},
year = {2026},
eprint = {2608.23283},
archivePrefix = {arXiv},
primaryClass = {cs.AI},
url = {https://arxiv.org/abs/2608.23283}
}
@misc{frontierchallenge,
title = {FrontierChallenge: Evaluating Scientific Workflow Completion},
author = {Su, Liangcai and Feng, Zhaopeng and Chen, Zhuo and Zhang, Zhen
and Lin, Xiang and Li, Ruilin and Zhang, Handuo and Wang, Ning
and Wen, Kailong and Guo, Yueqi and Xing, Feng and Guo, Yiling
and Qian, Chenxiong and Du, Simon Shaolei and Bing, Lidong
and Wang, Xinyu},
year = {2026}
}
For work that refers specifically to the previous generation:
@techreport{apodex10,
title = {Apodex-1.0: A Verification-Centric Agent Team for Discoverative Intelligence},
author = {Apodex Team},
year = {2026}
}
License
Apache 2.0 — see LICENSE.
Star History
相似文章
@Xudong07452910: 开源项目推荐:Autocontext —— 让你的 AI Agent 递归自我进化 Autocontext 是一个递归自我改进的 harness,专为帮助你的 AI Agent(及其未来迭代)在任何任务上持续成功而设计。它通过迭代执行、真…
Autocontext 是一个开源递归自我改进 harness,帮助 AI Agent 通过迭代执行、评估和知识积累持续优化,生成可复用的 playbook、数据集甚至本地模型,适合构建生产级 Agent 工作流的开发者。
@xiaohu: 昨天看很多人转发Apodex 1.1 一个专门面向深度研究而打造的 Agent 专门解决那种"没有现成答案、需要大量调研才能搞定"的硬问题 好奇测试了下,跑了俩任务,一下午都没跑完 执行时间是真长 这玩意能你只要给它个目标,它就能能长时间…
Apodex 1.1 是一个专为深度研究设计的AI代理,能处理需要大量调研的复杂任务,通过主代理分解问题并异步派发多个子代理执行,支持长时间运行和自动恢复。
@vintcessun: 今晚翻到一个学习路线项目,重新理解了Agent该从哪开始学。以前总觉得Agent就是堆工具和框架,但它的核心是那个“观察-思考-执行”循环,以及harness工程对权限、状态、回溯的组织。它把学习拆成从0构建最小Agent loop到最终…
一个名为Agent-Learning-Hub的开源学习路线项目,将AI Agent学习拆分为8个阶段,从构建最小Agent loop到生产部署,提供可执行的todo list和推荐资源,由Datawhale社区成员维护。
@Xudong07452910: 如果你最近在关注 AI Scientist,我很推荐这篇文章。 现在很多 Research Agent 还是先生成大量实验和假设,再让 Judge 选最好的。 做研究往往是一次失败以后,能不能知道自己哪里理解错了,还有哪些地方没探索过。 …
这篇文章推荐关注AI Scientist,并讨论研究代理如何通过类比模糊测试来学习失败,从而绘制未知地图并指导后续实验。
@Xudong07452910: RL 训练 LLM Agent 有个经典难题: 一次长任务失败后,模型到底该从哪里学起? 最终奖励通常只能告诉 Agent「成功或失败」,却很难指出中间哪些判断值得保留,哪些动作把整条轨迹带偏了。 这篇论文提出 SEED,用「自进化在线蒸…
这篇论文提出SEED方法,通过自进化在线蒸馏将轨迹中的事后技能内化到模型参数中,解决长任务RL训练中奖励稀疏的问题,在ALFWorld等基准上取得了显著提升。