error-budget

Tag

Cards List
#error-budget

Flat Score, Amplified Failures: How the Error Budget Masks Damage in Quantized LLM Agents

arXiv cs.LG · 2d ago Cached

This paper investigates the claim that 4-bit weight quantization is nearly lossless for LLM agents, showing that while aggregate benchmark scores stay flat, quantization amplifies existing tool-call failures (e.g., hallucination), hidden by the benchmark's error budget. The authors suggest reporting per-channel error rates and success under shrinking budgets to reveal the masked damage.

0 favorites 0 likes
← Back to home

Submit Feedback