40 citations · 106 across the 28 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 2 cited
Depth separation beyond radial functions
Luca Venturi, Samy Jelassi, Tristan Ozuch +1
High-dimensional depth separation results for neural networks show that certain functions can be efficiently approximated by two-hidden-layer networks but not by one-hidden-layer o…
cs.LG2021★ 40 cited
Adaptivity without Compromise: A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization
Aaron Defazio, Samy Jelassi
We introduce MADGRAD, a novel optimization method in the family of AdaGrad adaptive gradient methods. MADGRAD shows excellent performance on deep learning optimization problems fro…