Tag
This arXiv chapter argues that uncertainty, explainability, and human responsibility are three essential principles for the legitimate integration of AI-based decision-making systems in education.
本文提出了一种基于标签保持扰动的输入歧义检测框架,先检测再消歧,包含黑盒规则库与白盒重要性引导两种检测器,在四类问答数据集上优于输出侧不确定性基线与LLM改写扰动基线。
论文提出 AskStream,首个覆盖视频与用户不确定性的流式视频理解多轮基准,重新定义主动交互为等待、提问、回答三类动作,并指出即使最强模型在 Ask-F1 指标上也仅有 52.18%,凸显主动信息获取的不足。
This paper audits a cheap frozen 'System One' classification model against 14 frontier LLMs on content moderation, finding it accuracy-competitive at far lower cost, and shows that 'confidence' conflates two distinct uncertainties—human disagreement and decision risk—that require opposite escalation signals.
这篇博文论证了让 LLM 自行生成置信度分数是不可靠的做法:置信度本质上应是基于信息的概率计算与校准结果,而 LLM 给出的数字缺乏可验证的依据,无法被信任。
该论文研究了不同训练策略与损失函数对长尾/不平衡数据上集值分类器(SVC)性能的影响,并改进了 odd-KK-out(OKO)损失,将其计算开销从3.2×降至1.36×,显著提升了多个SVC方法的宏平均准确率。
This paper proposes a post-hoc latent projection method for latent world model planning that prunes noisy latent directions by fitting the state dynamics matrix and restricting the ℓ2 planning cost to the least-uncertain subspace, reporting up to +54.7 points success-rate gains on 2D navigation tasks like TwoRoom and PointMaze.
The author explores how RAG evaluations should distinguish three different reasons a system answers "I don't know" — retrieval failure, missing evidence, and conflicting sources — and proposes evals that label the expected unresolved state rather than just scoring answers as correct, incorrect, or refused.
Independent researcher Lev Goukassian introduces his Ternary Logic (TL) and Ternary Moral Logic (TML) frameworks, arguing that the ability for AI systems to pause under uncertainty or risk must be an architectural principle rather than a promise.
该研究提出"加性分歧(AD)"指标,评估扰动预测模型在未见过的基因组合上的外推可靠性,发现专门的神经预测模型并未稳定优于简单加性基线,且偏离基线越大的预测误差越大,该信号可指导自动扰动筛选工作流。
论文推导了一个一阶公式,用于预测在掩码文本重建任务中,两个独立语料训练的预测器之间的期望分歧,并在 TinyStories、WikiText-103 和 CNN/DailyMail 上验证了该预测的准确性及其局限性。
该论文提出一种不确定性引导的渐进收缩框架,通过构建蒙特卡洛推理树评估过程级不确定性,并在SFT阶段进行在线路由,仅使用全量SFT约0.22%的优化预算(减少450倍以上的训练暴露)即可维持或提升LLM的推理能力。
ProbabilityBench introduces a benchmark with exactly known ground-truth class probabilities, allowing direct measurement of how well models, including decision models like Jev and Perplexity Decider, estimate true probabilities and enabling evaluation of calibration metrics and Bayes-error estimators.
该论文研究了当音频、视频和文本三个通道的评分冲突时,策略如何在请求第三个来源与弃权之间做决策,提出阈值策略并在受控基准上评估其相对于多数投票和融合策略的效用表现。
该论文提出以“认知谦逊”(Epistemic Humility)评估 LLM 智能体在知识冲突下的表现,通过 Identify、Solve、Escalate 三个轨迹级维度进行衡量,发现高任务准确率并不意味着更高的认知谦逊,且模型级干预往往以牺牲准确率为代价。
This paper formalizes 'actionable indeterminacy' for LLM agents—distinguishing when to act, ask for clarification, or repair constraints—and builds a solver-grounded benchmark showing models frequently over-intervene, failing to act when a justified action already exists.
The paper proposes Soft Spatial Reasoning, a post-training framework that introduces adaptive "soft thinking" for spatial tasks in Large Vision-Language Models, where intermediate reasoning steps mix token embeddings instead of committing to a single discrete token. An AdaptSoft controller dynamically adjusts softness based on hidden state and predictive uncertainty, outperforming hard and fixed-soft CoT baselines on spatial benchmarks.
Introduces the Sys1Cal-v1 dataset for evaluating probability calibration in AI models, showing that models like Jev may suppress uncertainty in binary outputs.
The paper introduces a vector Bellman theory for robust average-reward Markov decision processes, enabling optimal performance under transition uncertainty with finite model solvability and an approximately shifted Halpern planning algorithm.
RAND proposes a 'Freedom of Action' strategy for the U.S. to navigate the uncertain path to artificial superintelligence, keeping major options open until evidence dictates a choice.