model-cascade

Tag

Cards List
#model-cascade

UCCI: Calibrated Uncertainty for Cost-Optimal LLM Cascade Routing

arXiv cs.LG ↗ · 2026-05-20 Cached

UCCI proposes a calibration-first router for LLM cascades that uses isotonic regression to map token-level margin uncertainty to error probability, achieving a 31% cost reduction on a production NER workload while maintaining micro-F1=0.91 and reducing expected calibration error from 0.12 to 0.03.

0 favorites 0 likes
← Back to home

Submit Feedback