accuracy-controlled

Tag

Cards List
#accuracy-controlled

When Calibration Rankings Reverse: Accuracy-Controlled Evaluation for Fair Comparison of LLMs

arXiv cs.CL · 2026-07-01 Cached

This paper demonstrates that global calibration metrics like Expected Calibration Error are confounded by model accuracy, and proposes ACE, an accuracy-controlled evaluation framework for fair comparison of large language models.

0 favorites 0 likes
← Back to home

Submit Feedback