mixture-collapse

Tag

Cards List
#mixture-collapse

The Dynamics of Continuous Mixture Collapse in Language Models

arXiv cs.LG · 4d ago Cached

The paper examines why pretrained language models fail to preserve continuous mixtures of token embeddings in reasoning, identifying architectural distortions and dynamical system effects as primary failure sources.

0 favorites 0 likes
← Back to home

Submit Feedback