17 citations · 30 across the 7 of their papers we have counts for
3 papers · 1 filter
: A Fast sketching based solver for large scale ridge regression
Nidham Gazagnadou, Mark Ibrahim, Robert M. Gower
We propose new variants of the sketch-and-project method for solving large scale ridge regression problems. Firstly, we propose a new momentum alternative and provide a theorem sho…
Towards closing the gap between the theory and practice of SVRG
Othmane Sebbouh, Nidham Gazagnadou, Samy Jelassi +2
Among the very first variance reduced stochastic methods for solving the empirical risk minimization problem was the SVRG method (Johnson & Zhang 2013). SVRG is an inner-outer loop…
Optimal mini-batch and step sizes for SAGA
Nidham Gazagnadou, Robert M. Gower, Joseph Salmon
Recently it has been shown that the step sizes of a family of variance reduced gradient methods called the JacSketch methods depend on the expected smoothness constant. In particul…