不要选出赢家:知识冲突需要先验,而非规则
摘要
该论文提出知识冲突的解决不应依赖固定的启发式规则,而应引入对上下文可靠性的事先概率先验;在 GRACE 与 ClashEval 基准上,基于先验偏移的双声部选择器在各种上下文混合比例下显著优于现有基线。
arXiv:2610.36169v1 Announce Type: new
Abstract: A retrieval-augmented language model answers from two sources, the retrieved context and its own knowledge, and the two disagree whenever the context is incomplete or wrong. Existing methods settle the disagreement with a rule fixed at design time: follow the context, amplify it in proportion to how far it moves the model, or trust the model's memory. Each rule is confidently wrong in some deployment. In a decision-theoretic model of two sources, the score of any fixed rule is linear in the share of reliable contexts while the best attainable score is convex, so every fixed rule is beaten wherever it is not exactly optimal; and a symmetric divergence between the two sources, the signal adaptive decoding uses, carries no information about which one is right. Resolving a conflict therefore needs two inputs that no existing method keeps: evidence about each source separately, and a prior on how often the context is right. We test these claims on GRACE, a benchmark that intervenes on the knowledge-graph context of a fixed question, so that what the model knows, what the context says and what is true are measured separately. There, every baseline from four families is strong on right contexts or on wrong ones, never on both. We then build the two inputs: the model states its knowledge as notes, a small policy voices each note with a calibrated confidence, a reader answers in two voices, and a selector commits or abstains under a prior $\pi$ applied as an exact prior shift. With $\pi$ set to the true share of right contexts, the system is above the best baseline at every mixture of GRACE contexts, by up to 26 points. Its overall score is 45.3 and 35.0 (Qwen3.5-35B-A3B, Llama-3.1-8B), against 29.4 and 27.5 for the best baseline. On preregistered ClashEval it beats same-backbone CK-PLUG and TCR by 12 and 26 points. Where the model lacks the knowledge, the gains vanish, as the theory predicts.
查看缓存全文
缓存时间: 2026/10/28 07:34
# Don't Pick a Winner: Knowledge Conflicts Need a Prior, Not a Rule Source: [https://arxiv.org/abs/2610.36169](https://arxiv.org/abs/2610.36169) [View PDF](https://arxiv.org/pdf/2610.36169)[HTML \(experimental\)](https://arxiv.org/html/2610.36169v1) > Abstract:A retrieval\-augmented language model answers from two sources, the retrieved context and its own knowledge, and the two disagree whenever the context is incomplete or wrong\. Existing methods settle the disagreement with a rule fixed at design time: follow the context, amplify it in proportion to how far it moves the model, or trust the model's memory\. Each rule is confidently wrong in some deployment\. In a decision\-theoretic model of two sources, the score of any fixed rule is linear in the share of reliable contexts while the best attainable score is convex, so every fixed rule is beaten wherever it is not exactly optimal; and a symmetric divergence between the two sources, the signal adaptive decoding uses, carries no information about which one is right\. Resolving a conflict therefore needs two inputs that no existing method keeps: evidence about each source separately, and a prior on how often the context is right\. We test these claims on GRACE, a benchmark that intervenes on the knowledge\-graph context of a fixed question, so that what the model knows, what the context says and what is true are measured separately\. There, every baseline from four families is strong on right contexts or on wrong ones, never on both\. We then build the two inputs: the model states its knowledge as notes, a small policy voices each note with a calibrated confidence, a reader answers in two voices, and a selector commits or abstains under a prior $\\pi$ applied as an exact prior shift\. With $\\pi$ set to the true share of right contexts, the system is above the best baseline at every mixture of GRACE contexts, by up to 26 points\. Its overall score is 45\.3 and 35\.0 \(Qwen3\.5\-35B\-A3B, Llama\-3\.1\-8B\), against 29\.4 and 27\.5 for the best baseline\. On preregistered ClashEval it beats same\-backbone CK\-PLUG and TCR by 12 and 26 points\. Where the model lacks the knowledge, the gains vanish, as the theory predicts\. ## Submission history From: Minh Pham Van \[[view email](https://arxiv.org/show-email/0136c89b/2610.36169)\] **\[v1\]**Mon, 26 Oct 2026 19:03:29 UTC \(440 KB\)
相似文章
我们需要大语言模型来理解来源为何冲突吗?面向 RAG 中知识冲突类型判定的决策模型
该论文研究了在RAG知识冲突分类任务中使用类型化决策模型替代大语言模型的可行性,结果表明,决策模型在成本仅为其1/4至1/39、延迟更低的情况下,可达到或超过Gemini 2.5 Flash的准确率。
独立及非负相关噪声下赢家偏差的紧界
该论文确定了在独立非同分布噪声和两两非负相关噪声下,选择最大噪声分数所产生的“赢家偏差”的尖锐常数界,并将全部定理在 Lean 4 中形式化验证,同时在 448 个模型选择流程上验证了结论的实际意义。
从上下文感知到冲突感知:将对比解码推广到LLM中的知识冲突
该论文将对比解码推广到一种冲突感知范式,该范式在外部上下文和参数先验之间动态分配权威,提出了TriState-Bench评估协议,并引入了自适应机制路由(ARR)来解决修正与抵抗之间的不对称性。
准确但不谦逊:评估知识冲突下 LLM 智能体的认知谦逊
该论文提出以“认知谦逊”(Epistemic Humility)评估 LLM 智能体在知识冲突下的表现,通过 Identify、Solve、Escalate 三个轨迹级维度进行衡量,发现高任务准确率并不意味着更高的认知谦逊,且模型级干预往往以牺牲准确率为代价。
三通道评分冲突中的受控获取与弃权
该论文研究了当音频、视频和文本三个通道的评分冲突时,策略如何在请求第三个来源与弃权之间做决策,提出阈值策略并在受控基准上评估其相对于多数投票和融合策略的效用表现。