Tag
Yale researchers use influence functions to identify indirect evidence in language model training data across 15 BLiMP grammatical phenomena, showing that removing the top influential sentences lowers held-out accuracy significantly more than removing random controls, and characterizing how this evidence relates to linguistic structure.