Tag
This paper studies critical points in deep fully-connected networks with monomial activations, proving that for large activation degree, criticality occurs precisely at subnetworks, offering a mathematical perspective on implicit bias toward simpler functions.