critical-points

Tag

Cards List
#critical-points

Population loss in shallow ReLU networks: Bias & families of critical points

arXiv cs.LG ↗ · 2026-09-29 Cached

This paper derives a formula for population loss in shallow ReLU networks with bias, showing that bias strictly decreases loss and extends known families of critical points.

0 favorites 0 likes
#critical-points

Singular Learning and Occam's Razor in Deep Monomial Networks

arXiv cs.LG ↗ · 2026-06-30 Cached

This paper studies critical points in deep fully-connected networks with monomial activations, proving that for large activation degree, criticality occurs precisely at subnetworks, offering a mathematical perspective on implicit bias toward simpler functions.

0 favorites 0 likes
← Back to home

Submit Feedback