glu-mlp

This paper presents Fairness Pruning, a structural intervention method that locates demographic bias in GLU-MLP layers of large language models by identifying differentially activated neurons. Zeroing a very small number of neurons disrupts bias processing while preserving reasoning and general knowledge, suggesting bias and capabilities rely on dissociable circuits.