别忘记你刚刚学到的:自主纠错将智能体的错误转化为持久的经验教训

arXiv cs.AI 论文

摘要

提出 Self-Direction 机制,让智能体在任务失败后自我反思并将教训蒸馏进轻量级 LoRA 适配器,构建可持久复用的教训库,在 GAIA、Claw-Eval 和 Terminal-Bench 2.1 上将成功率提升 8.9 至 17.0 个百分点,并显著减少重复犯错。

arXiv:2610.31846v1 Announce Type: new Abstract: Intelligent agents should learn from their mistakes so that experience leads to continuous improvement. Yet today's agents recover from a mistake only temporarily: in-context reflections are easily forgotten across sessions and compete for limited context, while full-parameter fine-tuning is expensive and can interfere with existing capabilities. We introduce Self-Direction, a mechanism for agents to learn from mistakes that combines the benefits of temporary in-context retries and policy updates. When an agent fails a task, it reflects on its own trajectory in order to extract a lesson and immediately distills it into a lightweight low-rank adapter. By keeping the original weights frozen, Self-Direction prevents adapter training from overwriting base-model parameters while training additional parameters equivalent to ~0.02% of the base model's parameter count for each adapter. The agent then saves these adapters in a persistent library of lessons, automatically routing them to solve related problems later. Experiments with agents based on open-weight models from the Qwen family across open-ended research (GAIA), tool-use workflows (Claw-Eval), and terminal tasks (Terminal-Bench 2.1) show that our method improves overall success rates by 8.9 to 17.0 percentage points and performs competitively with frontier systems. We find that Self-Direction reduces repeated mistakes across future encounters of a task, nearly doubling the reliability of an agent's corrections. Learned lessons also transfer: a handful of adapters generalize to dozens of new tasks without additional training. Ultimately, this self-directed repair transforms everyday mistakes into lasting lessons.
查看原文

相似文章

@Saccc_c: 受大神Karpathy的HackerTube启发,我做了一个「AnliBili」网站,专门集合16年来社媒上被反复安利的B站高质量视频,帮你消除信息噪音! 通过将知乎、小红书上16年来近1000万条讨论进行整理、分类,我筛选出了1132个…

X AI KOLs Following

受Karpathy的HackerTube启发,作者用Teamily AI的多Agent工作流搭建了「AnliBili」网站,从知乎、小红书16年近1000万条讨论中筛选出1132个被反复安利的B站高质量视频,帮助用户消除信息噪音。

The Download:控制 AI 智能体与“超级智能”忠诚度测试

MIT Technology Review

MIT Technology Review 的每日通讯关注以下内容:以反向博弈论来控制 AI 智能体、特朗普将“Super Intelligence”重新品牌化作为一次忠诚度考验,以及今天的美国中期选举将如何检验 AI 的政治影响力。

当 Qwen 卡住不停说「Wait」时,它在想什么

Reddit r/LocalLLaMA

一项实验利用可解释性视角分析 Qwen3.5-0.8B 为何会卡住并反复说「Wait」,发现在接近停止点的位置,与怀疑相关的特征占据主导;随后通过一次极小的权重编辑(仅涉及 0.016% 的权重),将「Wrong/Nope/Hmm」转化为「Verification/Completion/Result」,使 MATH-500 表现大幅提升;代码与数据已公开。

Qwen 3.8 27B 仍然是王者吗

Reddit r/LocalLLaMA

一位社区成员询问,在他们离线期间,是否有任何 8B–35B 参数规模的新 AI 模型超越了 Qwen 3.8 27B。