不要选出赢家:知识冲突需要先验,而非规则

arXiv cs.AI 论文

摘要

该论文提出知识冲突的解决不应依赖固定的启发式规则,而应引入对上下文可靠性的事先概率先验;在 GRACE 与 ClashEval 基准上,基于先验偏移的双声部选择器在各种上下文混合比例下显著优于现有基线。

arXiv:2610.36169v1 Announce Type: new Abstract: A retrieval-augmented language model answers from two sources, the retrieved context and its own knowledge, and the two disagree whenever the context is incomplete or wrong. Existing methods settle the disagreement with a rule fixed at design time: follow the context, amplify it in proportion to how far it moves the model, or trust the model's memory. Each rule is confidently wrong in some deployment. In a decision-theoretic model of two sources, the score of any fixed rule is linear in the share of reliable contexts while the best attainable score is convex, so every fixed rule is beaten wherever it is not exactly optimal; and a symmetric divergence between the two sources, the signal adaptive decoding uses, carries no information about which one is right. Resolving a conflict therefore needs two inputs that no existing method keeps: evidence about each source separately, and a prior on how often the context is right. We test these claims on GRACE, a benchmark that intervenes on the knowledge-graph context of a fixed question, so that what the model knows, what the context says and what is true are measured separately. There, every baseline from four families is strong on right contexts or on wrong ones, never on both. We then build the two inputs: the model states its knowledge as notes, a small policy voices each note with a calibrated confidence, a reader answers in two voices, and a selector commits or abstains under a prior $\pi$ applied as an exact prior shift. With $\pi$ set to the true share of right contexts, the system is above the best baseline at every mixture of GRACE contexts, by up to 26 points. Its overall score is 45.3 and 35.0 (Qwen3.5-35B-A3B, Llama-3.1-8B), against 29.4 and 27.5 for the best baseline. On preregistered ClashEval it beats same-backbone CK-PLUG and TCR by 12 and 26 points. Where the model lacks the knowledge, the gains vanish, as the theory predicts.
查看原文
查看缓存全文

缓存时间: 2026/10/28 07:34

# Don't Pick a Winner: Knowledge Conflicts Need a Prior, Not a Rule
Source: [https://arxiv.org/abs/2610.36169](https://arxiv.org/abs/2610.36169)
[View PDF](https://arxiv.org/pdf/2610.36169)[HTML \(experimental\)](https://arxiv.org/html/2610.36169v1)

> Abstract:A retrieval\-augmented language model answers from two sources, the retrieved context and its own knowledge, and the two disagree whenever the context is incomplete or wrong\. Existing methods settle the disagreement with a rule fixed at design time: follow the context, amplify it in proportion to how far it moves the model, or trust the model's memory\. Each rule is confidently wrong in some deployment\. In a decision\-theoretic model of two sources, the score of any fixed rule is linear in the share of reliable contexts while the best attainable score is convex, so every fixed rule is beaten wherever it is not exactly optimal; and a symmetric divergence between the two sources, the signal adaptive decoding uses, carries no information about which one is right\. Resolving a conflict therefore needs two inputs that no existing method keeps: evidence about each source separately, and a prior on how often the context is right\. We test these claims on GRACE, a benchmark that intervenes on the knowledge\-graph context of a fixed question, so that what the model knows, what the context says and what is true are measured separately\. There, every baseline from four families is strong on right contexts or on wrong ones, never on both\. We then build the two inputs: the model states its knowledge as notes, a small policy voices each note with a calibrated confidence, a reader answers in two voices, and a selector commits or abstains under a prior $\\pi$ applied as an exact prior shift\. With $\\pi$ set to the true share of right contexts, the system is above the best baseline at every mixture of GRACE contexts, by up to 26 points\. Its overall score is 45\.3 and 35\.0 \(Qwen3\.5\-35B\-A3B, Llama\-3\.1\-8B\), against 29\.4 and 27\.5 for the best baseline\. On preregistered ClashEval it beats same\-backbone CK\-PLUG and TCR by 12 and 26 points\. Where the model lacks the knowledge, the gains vanish, as the theory predicts\.

## Submission history

From: Minh Pham Van \[[view email](https://arxiv.org/show-email/0136c89b/2610.36169)\] **\[v1\]**Mon, 26 Oct 2026 19:03:29 UTC \(440 KB\)

相似文章

独立及非负相关噪声下赢家偏差的紧界

arXiv cs.LG

该论文确定了在独立非同分布噪声和两两非负相关噪声下,选择最大噪声分数所产生的“赢家偏差”的尖锐常数界,并将全部定理在 Lean 4 中形式化验证,同时在 448 个模型选择流程上验证了结论的实际意义。

准确但不谦逊:评估知识冲突下 LLM 智能体的认知谦逊

Hugging Face Daily Papers

该论文提出以“认知谦逊”(Epistemic Humility)评估 LLM 智能体在知识冲突下的表现,通过 Identify、Solve、Escalate 三个轨迹级维度进行衡量,发现高任务准确率并不意味着更高的认知谦逊,且模型级干预往往以牺牲准确率为代价。

三通道评分冲突中的受控获取与弃权

arXiv cs.LG

该论文研究了当音频、视频和文本三个通道的评分冲突时,策略如何在请求第三个来源与弃权之间做决策,提出阈值策略并在受控基准上评估其相对于多数投票和融合策略的效用表现。