Rest-Katyusha: Exploiting the Solution's Structure via Scheduled Restart Schemes

Junqi Tang, Mohammad Golbabaee, Francis Bach +1

We propose a structure-adaptive variant of the state-of-the-art stochastic variance-reduced gradient algorithm Katyusha for regularized empirical risk minimization. The proposed me…