performance-bounds

This paper establishes a general theory of the Adam optimizer for time-varying and nonstationary stochastic systems, providing parameter tracking and output prediction error bounds under a stochastic excitation condition that allows nonstationary and dependent data.