Benjamin Dubois-Taine

activity

20212026

most citedTowards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent

1 citations · 1 across the 4 of their papers we have counts for

collaborators

Showing 2021Show all

2 papers · 1 filter

math.OC2021★ 1 cited

Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent

Sharan Vaswani, Benjamin Dubois-Taine, Reza Babanezhad

We aim to make stochastic gradient descent (SGD) adaptive to (i) the noise $σ^{2}$ in the stochastic gradients and (ii) problem-dependent constants. When minimizing smooth, strongly-…

cs.LG2021

SVRG Meets AdaGrad: Painless Variance Reduction

Benjamin Dubois-Taine, Sharan Vaswani, Reza Babanezhad +2

Variance reduction (VR) methods for finite-sum minimization typically require the knowledge of problem-dependent constants that are often unknown and difficult to estimate. To addr…