Nicolas Le Roux

activity

20112023

most citedA Stochastic Gradient Method with an Exponential Convergence Rate for Finite Training Sets

538 citations · 1.1k across the 31 of their papers we have counts for

collaborators

Showing 2013Show all

2 papers · 1 filter

math.OC2013

Minimizing Finite Sums with the Stochastic Average Gradient

Mark Schmidt, Nicolas Le Roux, Francis Bach

We propose the stochastic average gradient (SAG) method for optimizing the sum of a finite number of smooth convex functions. Like stochastic gradient (SG) methods, the SAG method'…

math.OC2013★ 82 cited

Fast Convergence of Stochastic Gradient Descent under a Strong Growth Condition

Mark Schmidt, Nicolas Le Roux

We consider optimizing a function smooth convex function $f$ that is the average of a set of differentiable functions $f_{i}$ , under the assumption considered by Solodov [1998] and T…