The complexity of first-order optimization methods from a metric perspective

Adrian S. Lewis, Tonghua Tian

A central tool for understanding first-order optimization algorithms is the Kurdyka-Lojasiewicz inequality. Standard approaches to such methods rely crucially on this inequality to…