66 citations · 159 across the 21 of their papers we have counts for
4 papers · 1 filter
L-SVRG and L-Katyusha with Arbitrary Sampling
Xun Qian, Zheng Qu, Peter Richtárik
We develop and analyze a new family of {\em nonaccelerated and accelerated loopless variance-reduced methods} for finite sum optimization problems. Our convergence analysis relies…
MISO is Making a Comeback With Better Proofs and Rates
Xun Qian, Alibek Sailanbayev, Konstantin Mishchenko +1
MISO, also known as Finito, was one of the first stochastic variance reduced methods discovered, yet its popularity is fairly low. Its initial analysis was significantly limited by…
SAGA with Arbitrary Sampling
Xu Qian, Zheng Qu, Peter Richtárik
We study the problem of minimizing the average of a very large number of smooth functions, which is of key importance in training supervised learning models. One of the most celebr…
SGD: General Analysis and Improved Rates
Robert Mansel Gower, Nicolas Loizou, Xun Qian +3
We propose a general yet simple theorem describing the convergence of SGD under the arbitrary sampling paradigm. Our theorem describes the convergence of an infinite array of varia…