On the stability of gradient descent with second order dynamics for time-varying cost functions

Travis E. Gibson, Sawal Acharya, Anjali Parashar +2

Gradient based optimization algorithms deployed in Machine Learning (ML) applications are often analyzed and compared by their convergence rates or regret bounds. While these rates…