Survey Descent: A Multipoint Generalization of Gradient Descent for Nonsmooth Optimization

X. Y. Han, Adrian S. Lewis

For strongly convex objectives that are smooth, the classical theory of gradient descent ensures linear convergence relative to the number of gradient evaluations. An analogous non…