uncertainty

Tag

Cards List
#uncertainty

AI-aided Decision-Making in Education - Uncertainty, Explainability, and Human Responsibility

arXiv cs.AI ↗ · 4d ago Cached

This arXiv chapter argues that uncertainty, explainability, and human responsibility are three essential principles for the legitimate integration of AI-based decision-making systems in education.

0 favorites 0 likes
#uncertainty

Detect Before You Disambiguate: Perturbation-Based Input Ambiguity Detection in LLMs

arXiv cs.CL ↗ · 2026-10-28 Cached

本文提出了一种基于标签保持扰动的输入歧义检测框架,先检测再消歧,包含黑盒规则库与白盒重要性引导两种检测器,在四类问答数据集上优于输出侧不确定性基线与LLM改写扰动基线。

0 favorites 0 likes
#uncertainty

AskStream: When and What to Ask Proactively under Uncertainty in Streaming Video Understanding

Hugging Face Daily Papers ↗ · 2026-10-28 Cached

论文提出 AskStream,首个覆盖视频与用户不确定性的流式视频理解多轮基准,重新定义主动交互为等待、提问、回答三类动作,并指出即使最强模型在 Ask-F1 指标上也仅有 52.18%,凸显主动信息获取的不足。

0 favorites 0 likes
#uncertainty

Two Uncertainties Are Not One: Disagreement versus Decision-Risk in Cheap Structured Content Moderation

arXiv cs.CL ↗ · 2026-10-27 Cached

This paper audits a cheap frozen 'System One' classification model against 14 frontier LLMs on content moderation, finding it accuracy-competitive at far lower cost, and shows that 'confidence' conflates two distinct uncertainties—human disagreement and decision risk—that require opposite escalation signals.

0 favorites 0 likes
#uncertainty

Using LLM for confidence scoring is a bad idea

Hacker News Top ↗ · 2026-10-21 Cached

这篇博文论证了让 LLM 自行生成置信度分数是不可靠的做法:置信度本质上应是基于信息的概率计算与校准结果,而 LLM 给出的数字缺乏可验证的依据,无法被信任。

0 favorites 0 likes
#uncertainty

Using Set Learning to Improve Set-Valued Classifiers on Long-tailed Data

arXiv cs.LG ↗ · 2026-10-21 Cached

该论文研究了不同训练策略与损失函数对长尾/不平衡数据上集值分类器(SVC)性能的影响,并改进了 odd-KK-out(OKO)损失,将其计算开销从3.2×降至1.36×,显著提升了多个SVC方法的宏平均准确率。

0 favorites 0 likes
#uncertainty

Latent Projection for Latent Planning

arXiv cs.LG ↗ · 2026-10-21 Cached

This paper proposes a post-hoc latent projection method for latent world model planning that prunes noisy latent directions by fitting the state dynamics matrix and restricting the ℓ2 planning cost to the least-uncertain subspace, reporting up to +54.7 points success-rate gains on 2D navigation tasks like TwoRoom and PointMaze.

0 favorites 0 likes
#uncertainty

An unanswered RAG question can mean three very different things

Reddit r/AI_Agents ↗ · 2026-10-19

The author explores how RAG evaluations should distinguish three different reasons a system answers "I don't know" — retrieval failure, missing evidence, and conflicting sources — and proposes evals that label the expected unresolved state rather than just scoring answers as correct, incorrect, or refused.

0 favorites 0 likes
#uncertainty

The Burden of Knowing: Why AI Must Learn to Pause

Reddit r/ArtificialInteligence ↗ · 2026-10-18

Independent researcher Lev Goukassian introduces his Ternary Logic (TL) and Ternary Moral Logic (TML) frameworks, arguing that the ability for AI systems to pause under uncertainty or risk must be an architectural principle rather than a promise.

0 favorites 0 likes
#uncertainty

Do Perturbation Predictors Learn Gene Interactions? Diagnosing Extrapolation in Agentic Screening

arXiv cs.LG ↗ · 2026-10-15 Cached

该研究提出"加性分歧(AD)"指标,评估扰动预测模型在未见过的基因组合上的外推可靠性,发现专门的神经预测模型并未稳定优于简单加性基线,且偏离基线越大的预测误差越大,该信号可指导自动扰动筛选工作流。

0 favorites 0 likes
#uncertainty

Forecasting Corpus-Sampling Disagreement in Masked Text Reconstruction

arXiv cs.CL ↗ · 2026-10-12 Cached

论文推导了一个一阶公式,用于预测在掩码文本重建任务中,两个独立语料训练的预测器之间的期望分歧,并在 TinyStories、WikiText-103 和 CNN/DailyMail 上验证了该预测的准确性及其局限性。

0 favorites 0 likes
#uncertainty

Learning More by Training Less: Uncertainty-Guided Progressive Contraction for Efficient Reasoning Post-Training

arXiv cs.AI ↗ · 2026-10-12 Cached

该论文提出一种不确定性引导的渐进收缩框架,通过构建蒙特卡洛推理树评估过程级不确定性,并在SFT阶段进行在线路由,仅使用全量SFT约0.22%的优化预算(减少450倍以上的训练暴露)即可维持或提升LLM的推理能力。

0 favorites 0 likes
#uncertainty

ProbabilityBench: Model Evaluation and Calibration with Exact Ground-Truth Uncertainty

Hugging Face Daily Papers ↗ · 2026-10-12 Cached

ProbabilityBench introduces a benchmark with exactly known ground-truth class probabilities, allowing direct measurement of how well models, including decision models like Jev and Perplexity Decider, estimate true probabilities and enabling evaluation of calibration metrics and Bayes-error estimators.

0 favorites 0 likes
#uncertainty

Controlled Acquisition and Abstention in Three-Channel Score Conflicts

arXiv cs.LG ↗ · 2026-10-09 Cached

该论文研究了当音频、视频和文本三个通道的评分冲突时,策略如何在请求第三个来源与弃权之间做决策,提出阈值策略并在受控基准上评估其相对于多数投票和融合策略的效用表现。

0 favorites 0 likes
#uncertainty

Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict

Hugging Face Daily Papers ↗ · 2026-10-08 Cached

该论文提出以“认知谦逊”(Epistemic Humility)评估 LLM 智能体在知识冲突下的表现,通过 Identify、Solve、Escalate 三个轨迹级维度进行衡量,发现高任务准确率并不意味着更高的认知谦逊,且模型级干预往往以牺牲准确率为代价。

0 favorites 0 likes
#uncertainty

Ask, Relax, or Act? Evaluating Actionable Indeterminacy in LLM Preference Reasoning

arXiv cs.CL ↗ · 2026-10-05 Cached

This paper formalizes 'actionable indeterminacy' for LLM agents—distinguishing when to act, ask for clarification, or repair constraints—and builds a solver-grounded benchmark showing models frequently over-intervene, failing to act when a justified action already exists.

0 favorites 0 likes
#uncertainty

Soft Spatial Reasoning

Hugging Face Daily Papers ↗ · 2026-09-30 Cached

The paper proposes Soft Spatial Reasoning, a post-training framework that introduces adaptive "soft thinking" for spatial tasks in Large Vision-Language Models, where intermediate reasoning steps mix token embeddings instead of committing to a single discrete token. An AdaptSoft controller dynamically adjusts softness based on hidden state and predictive uncertainty, outperforming hard and fixed-soft CoT baselines on spatial benchmarks.

0 favorites 0 likes
#uncertainty

Jev thinks "I don't know'', but doesn't say it: Introducing Sys1Cal-v1 Dataset for Probability Calibration

Hugging Face Daily Papers ↗ · 2026-09-28 Cached

Introduces the Sys1Cal-v1 dataset for evaluating probability calibration in AI models, showing that models like Jev may suppress uncertainty in binary outputs.

0 favorites 0 likes
#uncertainty

Vector Bellman Theory for Multichain Robust Average-Reward Markov Decision Processes

arXiv cs.LG ↗ · 2026-09-25 Cached

The paper introduces a vector Bellman theory for robust average-reward Markov decision processes, enabling optimal performance under transition uncertainty with finite model solvability and an approximately shifted Halpern planning algorithm.

0 favorites 0 likes
#uncertainty

RAND publishes a U.S. strategy for the path to superintelligence: keep every major option open until the evidence forces a choice

Reddit r/singularity ↗ · 2026-09-23 Cached

RAND proposes a 'Freedom of Action' strategy for the U.S. to navigate the uncertain path to artificial superintelligence, keeping major options open until evidence dictates a choice.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback