Universal halting times in optimization and machine learning

Levent Sagun, Thomas Trogdon, Yann LeCun

The authors present empirical distributions for the halting time (measured by the number of iterations to reach a given accuracy) of optimization algorithms applied to two random s…