uncertainty-calibration

Tag

Cards List
#uncertainty-calibration

CASEL: Consequence-Aware Selective Execution for Reliable Long-Horizon Tool-Using Agents

arXiv cs.AI ↗ · 6d ago Cached

论文提出 CASEL(Consequence-Aware Selective Execution Layer),一种模型无关的运行时分配策略,通过综合校准失败概率、后果严重性、可逆性、歧义性和证据新鲜度来为工具调用选择执行、验证、沙箱、澄清、审批或放弃等模式,仿真结果显示其将有害副作用轨迹比例从 14.75% 降至 7.02%。

0 favorites 0 likes
#uncertainty-calibration

Joint upper-bound coverage and route-choice utility: an empirical evaluation on two urban proxy tasks

arXiv cs.AI ↗ · 2026-10-08 Cached

This empirical study finds that joint upper-bound coverage of traffic speed forecasts can be substantially improved via calibration, yet improved coverage does not translate into better route-choice utility in frozen offline proxy tasks on Beijing and Chengdu road-speed data.

0 favorites 0 likes
#uncertainty-calibration

More Features Are Not More Evidence: Limits of Training-Free Human Activity Recognition with Jev

arXiv cs.AI ↗ · 2026-09-30 Cached

This paper evaluates Jev, a fixed general-purpose probabilistic decision model, for training-free human activity recognition on accelerometer data, finding it far below supervised models (macro-F1 0.038–0.118 vs 0.686–0.907) and showing that adding more numerical sensor features actually degrades performance unless paired with deterministic semantic renderings.

0 favorites 0 likes
#uncertainty-calibration

@FrankRHutter: The data science revolution continues. TabPFN-3.5 is live, claiming SOTA beyond the vanilla IID small data setting and …

X AI KOLs Timeline ↗ · 2026-09-15 Cached

TabPFN-3.5 is released, claiming state-of-the-art performance for tabular data beyond IID small data settings, with features like handling grouped and temporal data, uncertainty calibration, and faster inference.

0 favorites 0 likes
#uncertainty-calibration

Judge, Retrieve, or Abstain: Uncertainty-Guarded LLM Judging with Provable Risk Guarantees

arXiv cs.CL ↗ · 2026-08-19 Cached

This paper proposes a risk-controlled framework for using LLMs as judges in factual evaluation, calibrating uncertainty thresholds to maintain a user-specified error rate and routing to retrieval-augmented mode when needed, achieving higher coverage with provable reliability guarantees.

0 favorites 0 likes
#uncertainty-calibration

Invertible Logits Transformation for Accuracy-Preserving Post-Hoc Uncertainty Calibration

arXiv cs.LG ↗ · 2026-08-12 Cached

The paper proposes Invertible Logits Transformation (InvLT), a post-hoc calibration method that applies a learnable scalar MLP element-wise to logits, preserving accuracy while correcting nonlinear miscalibration more flexibly than temperature scaling.

0 favorites 0 likes
#uncertainty-calibration

Unscented KalmanNet: a hybrid deep learning filter with calibrated posterior covariance for nonlinear state estimation

arXiv cs.LG ↗ · 2026-08-06 Cached

This paper introduces Unscented KalmanNet (UKN), a hybrid deep learning filter that augments the Unscented Kalman Filter with learned components to improve state estimation accuracy and covariance calibration under unknown noise statistics and model mismatch. Experiments show significant RMSE reductions over UKF and other KalmanNet variants.

0 favorites 0 likes
#uncertainty-calibration

Efficient Bayesian Deep Ensembles via Analytic Predictive Inference

arXiv cs.LG ↗ · 2026-07-09 Cached

Introduces an efficient Bayesian deep ensemble method for predictive regression that combines low-dimensional ensemble representation, closed-form Bayesian aggregation, and independent ensemble training to achieve calibrated uncertainty estimates with computational efficiency.

0 favorites 0 likes
#uncertainty-calibration

SAGE: Answer-Conditioned Uncertainty Targets for Verbal Uncertainty Alignment

arXiv cs.CL ↗ · 2026-06-11 Cached

SAGE proposes a group-level uncertainty target that constructs an answer-conditioned uncertainty geometry over sampled responses to improve verbal uncertainty alignment in LLMs, and introduces GUPO for training. Experiments across reasoning tasks show improved uncertainty ranking and reduced overconfidence.

0 favorites 0 likes
#uncertainty-calibration

UNIQ: Conformal Calibration for Adaptive Conservatism in Offline Reinforcement Learning

arXiv cs.LG ↗ · 2026-06-09 Cached

UNIQ introduces a conformal calibration method for offline reinforcement learning that adapts conservatism per-state based on uncertainty, improving over IQL on some D4RL benchmarks while maintaining memory efficiency.

0 favorites 0 likes
#uncertainty-calibration

UCCI: Calibrated Uncertainty for Cost-Optimal LLM Cascade Routing

arXiv cs.LG ↗ · 2026-05-20 Cached

UCCI proposes a calibration-first router for LLM cascades that uses isotonic regression to map token-level margin uncertainty to error probability, achieving a 31% cost reduction on a production NER workload while maintaining micro-F1=0.91 and reducing expected calibration error from 0.12 to 0.03.

0 favorites 0 likes
#uncertainty-calibration

Agent-BRACE: Decoupling Beliefs from Actions in Long-Horizon Tasks via Verbalized State Uncertainty

arXiv cs.CL ↗ · 2026-05-13 Cached

This paper introduces Agent-BRACE, a method that decouples LLM agents into belief state and policy models to handle long-horizon tasks in partially observable environments. By verbalizing state uncertainty, it achieves significant performance improvements over baselines while maintaining constant context window size.

0 favorites 0 likes
#uncertainty-calibration

BitCal-TTS: Bit-Calibrated Test-Time Scaling for Quantized Reasoning Models

arXiv cs.AI ↗ · 2026-05-08 Cached

This paper introduces BitCal-TTS, a runtime controller that improves accuracy and reduces premature halting in quantized reasoning models by calibrating confidence signals during test-time scaling.

0 favorites 0 likes
← Back to home

Submit Feedback