universal-degradation

Tag

Cards List
#universal-degradation

When Is Noise Response Universal? Tokenization as the Hidden Variable in Language Models

arXiv cs.CL · 6d ago Cached

The study finds that neural language models degrade similarly under word-level noise but differently under character-level noise, with tokenization identified as the key hidden variable. It provides a method to predict model robustness without noisy evaluation and suggests noise-augmented training for install robustness.

0 favorites 0 likes
← Back to home

Submit Feedback