Accelerated Gradient Flow: Risk, Stability, and Implicit Regularization

Yue Sheng, Alnur Ali

Acceleration and momentum are the de facto standard in modern applications of machine learning and optimization, yet the bulk of the work on implicit regularization focuses instead…