75 citations · 131 across the 20 of their papers we have counts for
3 papers · 1 filter
Stop Wasting My Gradients: Practical SVRG
Reza Babanezhad, Mohamed Osama Ahmed, Alim Virani +3
We present and analyze several strategies for improving the performance of stochastic variance-reduced gradient (SVRG) methods. We first show that the convergence rate of these met…
Faster Stochastic Variational Inference using Proximal-Gradient Methods with General Divergence Functions
Mohammad Emtiyaz Khan, Reza Babanezhad, Wu Lin +2
Several recent works have explored stochastic gradient methods for variational inference that exploit the geometry of the variational-parameter space. However, the theoretical prop…
Non-Uniform Stochastic Average Gradient Method for Training Conditional Random Fields
Mark Schmidt, Reza Babanezhad, Mohamed Osama Ahmed +3
We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient…