@Xudong07452910: 最近看 Agent 自进化相关的工作,我一直比较关注一个问题: Agent 留下来的 trajectory,到底什么时候才值得被下一轮训练继续学习? 这次我拿 SEED 的一篇 self-evolving Agent 论文,丢进 Apod…

X AI KOLs Timeline 工具

摘要

这篇文章探讨了AI代理自进化中轨迹学习的重要性,并介绍了Apodex 1.1系统和开源工具FrontierAgent,用于执行和评估长时间的研究任务。

最近看 Agent 自进化相关的工作,我一直比较关注一个问题: Agent 留下来的 trajectory,到底什么时候才值得被下一轮训练继续学习? 这次我拿 SEED 的一篇 self-evolving Agent 论文,丢进 Apodex 1.1 完整跑了一次。 一开始,我让它拆解论文的方法、实验和关键 claim,并把结论对应到具体的 Figure / Table / evidence。 任务已经跑了一段之后,我又中途加了一条要求: 重点检查「错误 trajectory 会不会被总结成错误的 hindsight skill,再在后续训练中被持续强化」,同时保留前面已经完成的研究结果。 整个过程我录了下来。 我比较感兴趣的,其实就是任务发生变化之后,Agent 怎么继续维护一条已经跑起来的长任务。 Apodex 1.1 这次把 Agent 的「能力单位」定义得比较完整: 从理解目标,到真正进入文件、搜索和代码环境执行;过程中维护任务状态、接收新的反馈,根据变化继续调整,最后交付的结论还要能够被重新核查。 背后对应的是一套异步 Agent Team。不同 Subagent 可以并行推进,阶段性结果持续回到 Shared Task State,用户也可以在任务执行过程中继续介入。 放到 Agent 自进化里看,这一层其实很重要。 trajectory learning、reflection、skill learning 最后都依赖执行过程中留下来的经验。如果任务状态、证据来源和失败分支本身都不稳定,后面拿这些 trajectory 继续训练,很容易把噪声一起学进去。 Apodex 还把这条线继续延伸到了 AI4AI:用自动化流程把出题、trajectory 筛选、训练、评测和反思串起来。 官方实验里,他们用这套流程训练 Qwen3.5-0.8B,经过 10 轮自动迭代,评测总分从 51.0% 提升到了 56.0%。 所以这次体验下来,我更关注的是一个基础问题: Agent 怎么留下足够可靠、可追踪、可验证的执行过程,让这些经验之后真的能够被重新利用。 相关的模型和框架也都开放出来了: FrontierAgent 是开源的 Agent harness,支持 ReAct / Agent Team。做 Agent 的可以去 GitHub 看看: https://github.com/ApodexAI/FrontierAgent… Apodex 1.1 mini(35B)权重也已经放到 Hugging Face,可以本地部署,并和 FrontierAgent 搭配: https://huggingface.co/collections/apodex/apodex-11… 完整的 Apodex 1.1 workbench 已经上线。最直接的体验方式,就是丢一篇自己真的在看的 paper、一份数据或者代码进去,再在任务跑到一半时改一次要求,看看它怎么继续把任务跑下去: https://apodex.ai
查看原文
查看缓存全文

缓存时间: 2026/08/27 07:41

最近看 Agent 自进化相关的工作,我一直比较关注一个问题:

Agent 留下来的 trajectory,到底什么时候才值得被下一轮训练继续学习?

这次我拿 SEED 的一篇 self-evolving Agent 论文,丢进 Apodex 1.1 完整跑了一次。

一开始,我让它拆解论文的方法、实验和关键 claim,并把结论对应到具体的 Figure / Table / evidence。

任务已经跑了一段之后,我又中途加了一条要求:

重点检查「错误 trajectory 会不会被总结成错误的 hindsight skill,再在后续训练中被持续强化」,同时保留前面已经完成的研究结果。

整个过程我录了下来。

我比较感兴趣的,其实就是任务发生变化之后,Agent 怎么继续维护一条已经跑起来的长任务。

Apodex 1.1 这次把 Agent 的「能力单位」定义得比较完整:

从理解目标,到真正进入文件、搜索和代码环境执行;过程中维护任务状态、接收新的反馈,根据变化继续调整,最后交付的结论还要能够被重新核查。

背后对应的是一套异步 Agent Team。不同 Subagent 可以并行推进,阶段性结果持续回到 Shared Task State,用户也可以在任务执行过程中继续介入。

放到 Agent 自进化里看,这一层其实很重要。

trajectory learning、reflection、skill learning 最后都依赖执行过程中留下来的经验。如果任务状态、证据来源和失败分支本身都不稳定,后面拿这些 trajectory 继续训练,很容易把噪声一起学进去。

Apodex 还把这条线继续延伸到了 AI4AI:用自动化流程把出题、trajectory 筛选、训练、评测和反思串起来。

官方实验里,他们用这套流程训练 Qwen3.5-0.8B,经过 10 轮自动迭代,评测总分从 51.0% 提升到了 56.0%。

所以这次体验下来,我更关注的是一个基础问题:

Agent 怎么留下足够可靠、可追踪、可验证的执行过程,让这些经验之后真的能够被重新利用。

相关的模型和框架也都开放出来了:

FrontierAgent 是开源的 Agent harness,支持 ReAct / Agent Team。做 Agent 的可以去 GitHub 看看: https://github.com/ApodexAI/FrontierAgent…

Apodex 1.1 mini(35B)权重也已经放到 Hugging Face,可以本地部署,并和 FrontierAgent 搭配: https://huggingface.co/collections/apodex/apodex-11…

完整的 Apodex 1.1 workbench 已经上线。最直接的体验方式,就是丢一篇自己真的在看的 paper、一份数据或者代码进去,再在任务跑到一半时改一次要求,看看它怎么继续把任务跑下去: https://apodex.ai


ApodexAI/FrontierAgent

Source: https://github.com/ApodexAI/FrontierAgent

Apodex


Online Service Homepage Try Apodex API
Hugging Face Discord X License

Tech Blog · Tech Report

FrontierAgent

FrontierAgent is an open-source agent runtime, terminal product, and evaluation suite for long-horizon research and file-based work. The frontier-agent TUI ships two native workflows:

  • ReAct — one stateful agent researches, reads files, writes deliverables, runs commands, and iterates in a task-scoped sandbox.
  • Agent Team — a coordinator maintains a task board, delegates independent work to parallel sub-agents, collects their reports, and synthesizes the result.

The same workflow engine powers the benchmark runner used to evaluate Apodex models. The framework, tools, workflows, and evaluation layer remain separate, so each can be reused independently.

Want to try FrontierAgent without hosting a model?

Apodex-1.1 is available through the Apodex API Platform. Get an API key, connect its OpenAI-compatible endpoint, and start running FrontierAgent in minutes.

New here? Use the documentation index to find the right installation, SGLang, workflow, evaluation, or developer guide.

Apodex-1.1 benchmark results across professional work, finance, scientific research, and general reasoning tasks

Highlights

  • Native Agent Team workflow. The coordinator decomposes the request, dispatches bounded parallel assignments, receives structured reports, and can use an optional fast reporter for final evidence review.
  • Task Board. Agent Team’s add_task and update_task events appear live in the TUI sidebar with pending, active, completed, blocked, and cancelled state.
  • Sandboxed file work. Shell and file tools share one task-scoped filesystem: /inputs is read-only, /workspace is working state, and /outputs contains persistent deliverables. Authorization and sandbox failures are fail-closed.
  • Asynchronous intervention. Type while an agent is running to queue a new instruction. It is injected at the next safe turn boundary without discarding the active run. In Agent Team mode it steers the coordinator; already-running sub-agents are allowed to finish.
  • Transparent deliverables. On macOS/Docker, /outputs maps to .apodex/runs/<session-id>/outputs on the host. The same run directory also contains its checkpoint, trace, engine log, and trajectories.
  • Approval, trace, and recovery. Mutating operations show a diff and require approval unless --yes is enabled. Sessions are checkpointed, every action is traced locally, /revert restores session changes, and --resume continues a saved run.
  • Evaluation included. The subprocess runner supports research and file-grounded benchmarks, deterministic artifact collection, concurrency, progress inspection, and rerunning individual failures.

Conceptual Agent Team workflow: a main agent assigns work to expert sub-agents, collects asynchronous reports, requests verification when needed, and synthesizes the final report

Conceptual Agent Team workflow, from task delegation and asynchronous report collection to verification and final synthesis.

How it fits together

flowchart LR
    U["User / benchmark task"] --> TUI["TUI or subprocess runner"]
    TUI --> R["Stateful ReAct"]
    TUI --> C["Agent Team coordinator"]
    C --> B["Task board"]
    B --> S1["Sub-agent 1"]
    B --> S2["Sub-agent 2"]
    B --> SN["Sub-agent N"]
    R --> FS["Task sandbox"]
    S1 --> FS
    S2 --> FS
    SN --> FS
    FS --> I["/inputs (read-only)"]
    FS --> W["/workspace (working files)"]
    FS --> O["/outputs (deliverables)"]
    S1 --> C
    S2 --> C
    SN --> C
    C --> A["Final answer / report"]
    R --> A

The repository boundaries are intentional:

frontier_agent/  generic loop, scheduling, registries, AgentBus, observers
plugins/tools/   web, shell, file, sandbox, and team tool implementations
workflows/       ReAct and Agent Team pipelines, profiles, prompts, observers
apodex/          terminal CLI/TUI, approvals, sessions, traces, and Docker path
benchmarks/      public harness plus bundled FrontierSearchBench/FrontierChallenge

More detail: framework architecture, Agent Team, and Stateful ReAct. See run artifacts and timestamps for the on-disk layout.

Quick start

Requirements: Git, Python 3.12, uv, and an OpenAI-compatible model endpoint. Docker is optional.

git clone https://github.com/ApodexAI/FrontierAgent.git
cd FrontierAgent

uv sync --python 3.12 --extra dev
cp .env.example .env

Add your endpoint to .env:

OPENAI_API_KEY=your-key
OPENAI_BASE_URL=https://your-openai-compatible-endpoint/v1
OPENAI_MODEL=your-model-name

# Optional web research tools
SERPER_API_KEY=
JINA_API_KEY=

Start the TUI:

# Stateful single-agent workflow
uv run frontier-agent --mode react --cwd /path/to/project

# Coordinator plus parallel sub-agents
uv run frontier-agent --mode agent_team --cwd /path/to/project

uv sync above installs the lightweight terminal runtime. Scientific and document packages are intentionally optional in native mode; the agent installs only what a task actually needs into <project>/.apodex/runtime/native. The apodex command is retained as a compatibility alias.

Prefer a script that does all of the above? ./scripts/run-macos.sh and ./scripts/run-linux.sh set up a hosted-endpoint install, and ./scripts/run-linux-gpu.sh --install-system-deps --setup-only prepares a native, isolated SGLang environment on a Linux NVIDIA GPU. The step-by-step equivalent is the endpoint quickstart (中文教程), which requires neither model self-hosting nor Docker.

Local SGLang serving is pinned to reviewed NVIDIA driver / CUDA / SGLang tracks, and a mismatch surfaces late as opaque CUDA or Triton kernel errors during model load. Confirm your nvidia-smi driver against the GPU compatibility matrix before choosing an image tag or native pin. The GPU helper selects a reviewed userspace track from the host driver, but never installs or replaces the driver itself.

Deployment model

The operating system, FrontierAgent runtime, and model runtime are independent choices. “NVIDIA” describes the local model service, not how the agent itself runs. Unsure which applies to your machine or GPU provider? Start with the installation chooser.

EnvironmentFrontierAgent runtimeModel endpointStart here
macOSnative or Docker Desktophosted or another OpenAI-compatible endpointmacOS
Linux host/VMnative (default), bubblewrap, or Dockerhosted, native SGLang, or Docker SGLangLinux
managed Linux GPU containernative inside the provider containercustom GPU image or native SGLangGPU platforms
WindowsWSL2, treated as Linuxhosted or a WSL2-reachable endpointLinux/WSL2

Chinese-speaking macOS users can use the macOS 中文安装与一键启动指南.

Containers and local models

Pre-built linux/amd64 and linux/arm64 images are published to the GitHub Container Registry, so no local Python environment is needed:

cp .env.example .env
docker compose run --rm agent

Using the TUI

Run without a task for an interactive session, or pass one and stay in the session for follow-ups:

uv run frontier-agent --mode agent_team --cwd /repo \
  "Research the alternatives, verify the evidence, and write a report"

# One-shot, line mode, or resume a saved session
uv run frontier-agent --mode react --cwd /repo -p "explain src/main.py"
uv run frontier-agent --mode agent_team --no-tui "compare these implementations"
uv run frontier-agent --resume

# Attach read-only documents before the TUI starts (repeatable)
uv run frontier-agent --mode react --cwd /repo \
  --input ~/Downloads/claim.pdf --input ~/Desktop/photo.jpg

The sidebar carries the plan/task board, live tool activity, deliverables, and a session-scoped diff. While a workflow is busy, typing a follow-up queues it for the next safe turn boundary rather than interrupting the run.

For the four sidebar tabs, previews, approvals, attachments, clipboard support, keys, and Agent Team live steering, see the TUI user guide (中文使用教程). The full slash-command, option, and theming reference is apodex/README.md.

Workflow modes

ModeBest forExecution model
reactfocused research, repository analysis, document/file workone stateful agent using the tui workflow profile
agent_teambroad questions that benefit from decomposition and parallel investigationcoordinator, persistent task board, bounded parallel sub-agents, report collection, synthesis

Agent Team parallelism is additional to benchmark concurrency. When evaluating, start with --concurrency 1; total simultaneous model calls can approach runner concurrency multiplied by the team spawn limit.

Set SWARM_NO_WEB=1 to disable Agent Team web tools or REACT_NO_WEB=1 for closed-book ReAct tasks.

Filesystem and security model

PathPolicyPurpose
/inputsread-onlysupplied documents and benchmark inputs
/workspaceread-writesource checkout, extracted data, scratch work
/outputscontrolled read-writefinal persistent deliverables

File and shell tools share this one task sandbox and path policy. Interactive sessions add an approval gate on writes, deletion, package installation, and risky shell commands; some operations stay denied even with --yes; and file mutations are journaled so /revert can undo them.

Details: sandboxing and path policy, approval and trace behavior, and the security policy.

Development

uv sync --frozen --extra sandbox --extra document-readers --extra eval --extra dev
uv run pytest -q
uv run ruff check .

See CONTRIBUTING.md for the full development environment, pre-flight checks, session debugging, and submission process. Building the container image is covered in Run FrontierAgent in Docker.

Benchmark evaluation

The evaluation harness runs each benchmark question in an isolated subprocess, supports resumable multi-run experiments, and dispatches benchmark-specific deterministic or model-based judges. A minimal smoke run, once the datasets are downloaded per the evaluation guide, is:

uv sync --extra eval --extra sandbox --extra document-readers
uv run python -m benchmarks.public.runner.run_subprocess \
  --benchmark browsecomp --pipeline stateful-react-agent --profile default \
  --limit 1 --concurrency 1 --out ./results/smoke

The evaluation guide is the canonical operator reference for credentials, judge preflight, datasets, file benchmarks, execution, and result inspection. The benchmark registry lists dataset keys, default pipelines, scoring implementations, and extension points. FrontierSearchBench has its own external scorer and an isolation requirement, so it is documented separately in FrontierSearchBench evaluation.

Supported benchmarks

BrowseComp, BrowseComp-ZH, xbench-DeepResearch, Humanity’s Last Exam (text-only), SuperChem, FrontierScience-Research, FrontierScience-Olympiad, DeepSearchQA, WideSearch, FrontierSearchBench, OfficeQA, GDPval, APEX, and OneMillion-Bench.

GDPval uses deterministic deliverable validation in this open-source harness; the agentic pairwise grader is intentionally excluded. The benchmark registry is authoritative for each dataset key, its default pipeline, and its scoring implementation.

Apodex-1.1 performance

The chart above compares the two FrontierAgent workflows with the Apodex-1.0 baseline and selected external systems. The Apodex results are summarized here:

ConfigurationAPEX-AgentsGDPvalFrontierFinanceFrontierScience-ResearchBioMysteryBenchHLE
Apodex-1.1 Agent Team38.578.854.363.335.356.1
Apodex-1.1 ReAct34.469.548.755.023.553.2
Apodex-1.016.559.340.328.317.649.0

Earlier Apodex-1.0 checkpoints remain available in the Hugging Face collection, with model cards and serving guidance.

Citation

Cite the current release:

@article{apodex11,
  title         = {Apodex-1.1: Scaling Agentic Intelligence for Complex Work},
  author        = {Apodex Team},
  year          = {2026},
  eprint        = {2608.23283},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  url           = {https://arxiv.org/abs/2608.23283}
}
@misc{frontierchallenge,
  title        = {FrontierChallenge: Evaluating Scientific Workflow Completion},
  author       = {Su, Liangcai and Feng, Zhaopeng and Chen, Zhuo and Zhang, Zhen
                  and Lin, Xiang and Li, Ruilin and Zhang, Handuo and Wang, Ning
                  and Wen, Kailong and Guo, Yueqi and Xing, Feng and Guo, Yiling
                  and Qian, Chenxiong and Du, Simon Shaolei and Bing, Lidong
                  and Wang, Xinyu},
  year         = {2026}
}

For work that refers specifically to the previous generation:

@techreport{apodex10,
  title  = {Apodex-1.0: A Verification-Centric Agent Team for Discoverative Intelligence},
  author = {Apodex Team},
  year   = {2026}
}

License

Apache 2.0 — see LICENSE.

Star History

Star History Chart

相似文章

@Xudong07452910: 开源项目推荐:Autocontext —— 让你的 AI Agent 递归自我进化 Autocontext 是一个递归自我改进的 harness,专为帮助你的 AI Agent(及其未来迭代)在任何任务上持续成功而设计。它通过迭代执行、真…

X AI KOLs Timeline

Autocontext 是一个开源递归自我改进 harness,帮助 AI Agent 通过迭代执行、评估和知识积累持续优化,生成可复用的 playbook、数据集甚至本地模型,适合构建生产级 Agent 工作流的开发者。

@xiaohu: 昨天看很多人转发Apodex 1.1 一个专门面向深度研究而打造的 Agent 专门解决那种"没有现成答案、需要大量调研才能搞定"的硬问题 好奇测试了下,跑了俩任务,一下午都没跑完 执行时间是真长 这玩意能你只要给它个目标,它就能能长时间…

X AI KOLs Timeline

Apodex 1.1 是一个专为深度研究设计的AI代理,能处理需要大量调研的复杂任务,通过主代理分解问题并异步派发多个子代理执行,支持长时间运行和自动恢复。

@vintcessun: 今晚翻到一个学习路线项目,重新理解了Agent该从哪开始学。以前总觉得Agent就是堆工具和框架,但它的核心是那个“观察-思考-执行”循环,以及harness工程对权限、状态、回溯的组织。它把学习拆成从0构建最小Agent loop到最终…

X AI KOLs Timeline

一个名为Agent-Learning-Hub的开源学习路线项目,将AI Agent学习拆分为8个阶段,从构建最小Agent loop到生产部署,提供可执行的todo list和推荐资源,由Datawhale社区成员维护。

@Xudong07452910: RL 训练 LLM Agent 有个经典难题: 一次长任务失败后,模型到底该从哪里学起? 最终奖励通常只能告诉 Agent「成功或失败」,却很难指出中间哪些判断值得保留,哪些动作把整条轨迹带偏了。 这篇论文提出 SEED,用「自进化在线蒸…

X AI KOLs Timeline

这篇论文提出SEED方法,通过自进化在线蒸馏将轨迹中的事后技能内化到模型参数中,解决长任务RL训练中奖励稀疏的问题,在ALFWorld等基准上取得了显著提升。