Convergence of First-Order Algorithms with Momentum from the Perspective of an Inexact Gradient Descent Method

Pham Duy Khanh, Boris Mordukhovich, Dat Ba Tran

This paper introduces a novel inexact gradient descent method with momentum (IGDm) considered as a general framework for various first-order methods with momentum. This includes, i…