transformer-layers

This paper investigates how lexical diversity affects intrinsic dimensionality estimates in language model representations, revealing a scale-dependent transition between two regimes and deriving a formula for the reversal point.