Beyond Convexity -- Contraction and Global Convergence of Gradient Descent

Patrick M. Wensing, Jean-Jacques E. Slotine

This paper considers the analysis of continuous time gradient-based optimization algorithms through the lens of nonlinear contraction theory. It demonstrates that in the case of a…