Nesterov acceleration in benignly non-convex landscapes

Kanan Gupta, Stephan Wojtowytsch

While momentum-based optimization algorithms are commonly used in the notoriously non-convex optimization problems of deep learning, their analysis has historically been restricted…