Improving SAGA via a Probabilistic Interpolation with Gradient Descent

Adel Bibi, Alibek Sailanbayev, Bernard Ghanem +2

We develop and analyze a new algorithm for empirical risk minimization, which is the key paradigm for training supervised machine learning models. Our method---SAGD---is based on a…