plasticity-loss

This theoretical paper proposes a driven-nucleation rate law to explain capability emergence, plasticity loss, and circuit control in language models, supported by experiments on Pythia and a controlled gated-attention model.