理解多智能体大语言模型系统中的通信失败
摘要
提出一个基于语料库的多智能体LLM系统通信失败分类体系,基于3211条失败轨迹分析发现失败主要源于恢复/校正与共识/决策问题,而非首轮错误,并建议加强分歧处理与少数信号保留。
arXiv:2610.32060v1 Announce Type: new
Abstract: Multi-agent LLM systems aim to improve reasoning through debate, evidence sharing, and mutual correction, but interaction can also introduce failures that final accuracy alone cannot explain. Agents may converge too early, ignore dissent, suppress correct minority answers, or preserve a wrong framing across rounds. We present a corpus-grounded taxonomy of communication failures, built from 3,211 failed multi-round trajectories across medical QA, coding, finance, multi-hop reasoning, ethics, and embodied text tasks. Using this taxonomy, we analyze failure distributions across datasets and system designs, round-level error dynamics, recovery hardness, majority transitions, minority-signal suppression, and self-reported confidence. We find that failures are dominated by recovery/correction and consensus/decision problems rather than isolated first-round mistakes, with many emerging after agents first observe peer responses. Based on these findings, we recommend stronger disagreement handling, evidence verification, minority-signal preservation, and recovery checks before finalization.
相似文章
97.2% 的安全拦截机制在多跳智能体交接后不再发挥拦截作用(arXiv 新论文)。你会传递哪些信息,以确保“必须”始终是“必须”?
一篇新的 arXiv 论文(《当“必须”变成“也许”》,Sun 等人著)发现,在经过多跳智能体交接后,97.2% 的上游安全阻断约束会因压缩、计划同化或责任归属推延而失去约束力——即使权限保持不变——这表明,交接产物本身需要采用明确保留约束的设计。
@feijianghan:想入门 agentic RL 但不知道从哪开始?与几位研究者讨论后,我精选了……
一份由研究者精选的入门必读论文清单,共 3 篇:Search-R1 打基础,Agent Lightning v1.0 了解实践前沿,以及一篇综述纵览 LLM 的 agentic RL 全景。帖子附有 Search-R1 论文链接,该论文训练 LLM 在逐步推理过程中自主生成搜索查询并结合实时检索。
仅仅记住还不够:在多智能体系统中提炼记忆并学习何时使用它们
本文提出DiscernMem,一个免训练框架,通过缺陷感知记忆精炼与边界学习元记忆机制,帮助基于LLM的多智能体系统修正有缺陷的记忆并学习何时正确使用记忆,在AutoGen、CAMEL和MacNet上取得最佳平均分。
LM-DSB:一种用于自动生成施工每日安全简报的轻量级多智能体系统
该论文提出 LM-DSB,一个结合 RAG 与本地部署 LLM 的轻量级多智能体系统,用于自动生成建筑工地每日安全简报,在消费级硬件上实现了接近人工质量的文档生成与专家认可。
OA-RAG:基于本体的智能体式检索增强生成,用于忠实的大语言模型推理
OA-RAG 是一种智能体框架,将基于形式化本体的推理与大语言模型(LLM)推理相结合,以提高检索增强生成的忠实性,报告依据级别(逻辑蕴含、有支持、相关、不相关),并在基于大规模本体构建的医学问答基准上取得领先表现。