Tag
This paper derives a formula for population loss in shallow ReLU networks with bias, showing that bias strictly decreases loss and extends known families of critical points.