weight-spreading

A new ICML 2026 paper shows that spreading the same active weights across more neurons reduces collisions and improves accuracy in neural networks, suggesting networks can perform better without adding non-zero weights.