auto-regressive-risk

Tag

Cards List
#auto-regressive-risk

Reliability Scales Inversely: Bigger Models Compound Mistakes Faster via a Hidden Auto-Regressive Risk Regime

arXiv cs.LG · 6d ago Cached

This paper discovers that larger language models have a hidden auto-regressive risk regime where they commit to low-probability tokens and then snowball errors, causing reliability to degrade faster with scale. It shows that this failure mode is causal, dominant, and invisible to the model's own self-monitoring.

0 favorites 0 likes
← Back to home

Submit Feedback