潜在一致性:前沿语言模型的概率判断是否遵循全概率公式?
摘要
该论文研究前沿语言模型的概率判断是否满足全概率律(含因果 do-演算的后门调整),发现 GPT-6.1 Sol 和 Claude Opus 5.5 最一致,而推理长度与一致性无关,且一致性残差可在无真值情况下标记不可靠回答。
arXiv:2610.31833v1 Announce Type: new
Abstract: LawZero's Scientist AI trains a Predictor toward the Bayesian posterior, with an objective that penalizes inconsistent probabilities among latent explanations. We ask whether current frontier language models, with no such training, are already consistent in this sense zero-shot: do their probability judgments satisfy the law of total probability, $P(X)=\sum_z P(z)P(X|z)$, when the latent $z$ must be inferred from records in the context? In separate single-turn calls, models are asked for $P(X)$, for $P(z)$ over the latent's states, and for $P(X|z)$; a causal family applies the same test to $P(y|do(x))$ and the back-door adjustment. Every query has an exact ground-truth probability, and a subset of items is asked in three wordings to separate persistent incoherence from rewording noise. Across seven models, GPT-6.1 Sol and Claude Opus 5.5 are the most coherent (mean absolute residual 0.08 and 0.12 log-odds, about 2 percentage points). Claude Haiku 5.5, Gemini 3.8 Flash and DeepSeek V4-Pro show persistent incoherence (0.27-0.35 log-odds) that is mostly item-specific rather than a shared offset. Within every model, larger residuals go with larger errors against the truth (Spearman 0.40-0.62), so the residual, which needs no ground truth, flags unreliable answers. Reasoning length does not predict coherence, across models or within a model across rewordings of the same question. Simple consistency checks pass almost everywhere; the failures are specific to reasoning through a latent variable. Code and data: https://github.com/ppotash/latent-coherence
相似文章
研究发现AI模型存在与阅读难度相关的过度使用模式
纽约大学与德州大学奥斯汀分校的研究分析了14个AI模型的输出,发现多数前沿模型在罕见n-gram、长依赖、堆叠名词复合等与阅读难度相关的语言特征上存在过度使用现象。
RSI Arena:迈向基于人类反馈的递归自我改进
RSI Arena 推出了一项分为两个阶段的研究:十个前沿 AI 智能体在固定的 GPU 和 API 预算下,以人类偏好反馈为指导,从同一个基础模型出发,自主开展语言模型后训练。表现最强的智能体(GPT-6 Astra)弥合了基础模型与指令模型之间差距的 76%,且大多数模型在第二阶段比第一阶段更受人类青睐,展示了在结合人类反馈的递归自我改进(RSIHF)方向上迈出的一步。
一个模型,两条路径:平衡语言模型的单次推理与循环推理性能
该论文研究如何通过联合训练策略,让预训练语言模型同时支持单次前向和循环推理两种路径,在保留单次推理质量的同时获得循环计算带来的性能增益。
基于扰动的医学问答数据选择
本文研究了用于适配医学语言模型的基于扰动的数据选择方法(RSP 和 RSP-Drop)。在使用 MedGemma-4B 对五个医学问答数据集进行评估时,这些方法的 Macro-F1 分数优于随机选择方法。
偏好优化改进定义生成:欧盟机构可持续金融披露中的语义变化
论文提出使用直接偏好优化(DPO)微调定义生成器,以减少同一词义下定义过度分化的问题,并在学术基准和欧盟可持续金融术语的历时语义变化审计任务上进行了验证。