13 citations · 26 across the 5 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
stat.ML2020★ 13 cited
Quantitative Propagation of Chaos for SGD in Wide Neural Networks
Valentin De Bortoli, Alain Durmus, Xavier Fontaine +1
In this paper, we investigate the limiting behavior of a continuous-time counterpart of the Stochastic Gradient Descent (SGD) algorithm applied to two-layer overparameterized neura…
math.OC2020★ 1 cited
Convergence rates and approximation results for SGD and its continuous-time counterpart
Xavier Fontaine, Valentin De Bortoli, Alain Durmus
This paper proposes a thorough theoretical analysis of Stochastic Gradient Descent (SGD) with non-increasing step sizes. First, we show that the recursion defining SGD can be prova…