model-calibration

Tag

Cards List
#model-calibration

In Situ Training of Optical Neural Networks by Coding Agents

Hugging Face Daily Papers ↗ · 3d ago Cached

This paper introduces 'optics as code', a method where a coding agent trains an optical neural network from measurements alone by reparametrizing it with interpretable optical elements, outperforming gradient-free methods and approaching backpropagation accuracy at lower cost without per-device calibration.

0 favorites 0 likes
#model-calibration

Amortized Localized Posterior Inference for Model Calibration with Application to an Ocean Turbulence Closure

arXiv cs.AI ↗ · 2026-10-31 Cached

提出了一种基于条件归一化流的摊销变分推断方法,构建加权似然的局部后验来处理模型校准中的模型偏差与上下文不确定性,并在Branin-Hoo孪生实验及单柱海洋模型的k-ε湍流闭合校准中验证了其相较于全局后验的误差降低效果。

0 favorites 0 likes
#model-calibration

@michaelwaskom: I've been really excited about supporting TypeSafe bc they remind me a lot of early Modal: - actually new, interesting …

X AI KOLs Following ↗ · 2026-09-19 Cached

A user on social media expresses excitement about supporting TypeSafe, comparing it to early Modal for its innovative ideas, execution, and design, and emphasizes the relevance of model calibration in AI.

0 favorites 0 likes
#model-calibration

A Decision-Support Audit Protocol for Supervision Drift in Proxy-Labeled Credit-Risk Prediction

arXiv cs.LG ↗ · 2026-09-16 Cached

This paper presents a design-science audit protocol for detecting supervision drift in proxy-labeled credit-risk prediction models, with multi-signal diagnostics tested on LendingClub data.

0 favorites 0 likes
#model-calibration

Phase-Decoupled, Model-Calibrated Power Control for Disaggregated LLM Serving

arXiv cs.LG ↗ · 2026-09-11 Cached

This paper proposes a phase-decoupled, model-calibrated power control method for disaggregated LLM serving, demonstrating improved energy efficiency with minimal latency impact compared to NVIDIA's Max-Q profiles on MoE models.

0 favorites 0 likes
#model-calibration

Cactus Hybrid: We taught Gemma 4 to know when it's wrong

Reddit r/LocalLLaMA ↗ · 2026-07-22

Google's Gemma 4 model has been enhanced to recognize when it is incorrect, improving its calibration and reliability.

0 favorites 0 likes
#model-calibration

Temperature Scaling Is Not Enough: Calibration Gaps Under Human Label Distributions

arXiv cs.LG ↗ · 2026-07-16 Cached

This paper investigates the calibration gap that arises when temperature scaling, a common post-hoc calibration method relying on one-hot labels, is applied to models trained with soft label distributions reflecting genuine human disagreement. Experiments across vision and language domains show that temperature scaling calibrated on hard labels consistently underperforms direct soft-label calibration, with larger gaps in language tasks, highlighting risks for safety-critical deployments.

0 favorites 0 likes
#model-calibration

DualEval: Joint Model-Item Calibration for Unified LLM Evaluation

arXiv cs.LG ↗ · 2026-06-26 Cached

Introduces DualEval, a framework that jointly calibrates model ability and item difficulty/sharpness to unify static benchmark and arena-style evaluation, enabling more reliable rankings and downstream applications like benchmark compression and anomaly detection.

0 favorites 0 likes
#model-calibration

LLM Doesn't Know What It Doesn't Know: Detecting Epistemic Blind Spots via Cross-Model Attribution Divergence on Clinical Tabular Data

arXiv cs.AI ↗ · 2026-06-20 Cached

This paper explores Large Language Models' inability to recognize their knowledge limits on structured clinical data, proposing a cross-model attribution divergence method to detect epistemic blind spots. The approach improves calibration and accuracy without training by combining few-shot examples and SHAP-derived feature evidence.

0 favorites 0 likes
#model-calibration

When the Next Step Is Not One Step: Distribution-Aware Execution Modeling for Concurrent Go Programs

arXiv cs.LG ↗ · 2026-06-17 Cached

This paper proposes a distribution-aware training approach for modeling next-event predictions in concurrent Go programs, treating scheduler nondeterminism as a signal. Fine-tuning a 7B model on fewer than a thousand traces achieves 36.2% accuracy on production bugs, outperforming Gemini 3.5 Flash zero-shot.

0 favorites 0 likes
#model-calibration

When to Trust Tools? Adaptive Tool Trust Calibration For Tool-Integrated Math Reasoning

arXiv cs.CL ↗ · 2026-04-20 Cached

This paper introduces Adaptive Tool Trust Calibration (ATTC), a framework that improves tool-integrated reasoning models by enabling them to adaptively decide when to trust or ignore tool results based on code confidence scores. The approach addresses the "Tool Ignored" problem where models incorrectly dismiss correct tool outputs, achieving 4.1-7.5% performance improvements across multiple models and datasets.

0 favorites 0 likes
← Back to home

Submit Feedback