A Stable High-order Tuner for General Convex Functions

José M. Moreu, Anuradha M. Annaswamy

Iterative gradient-based algorithms have been increasingly applied for the training of a broad variety of machine learning models including large neural-nets. In particular, moment…