Surpassing Gradient Descent Provably: A Cyclic Incremental Method with Linear Convergence Rate

Aryan Mokhtari, Mert Gürbüzbalaban, Alejandro Ribeiro

Recently, there has been growing interest in developing optimization methods for solving large-scale machine learning problems. Most of these problems boil down to the problem of m…