1.6k citations · 2.7k across the 28 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.LG2017★ 120 cited
The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning
Siyuan Ma, Raef Bassily, Mikhail Belkin
In this paper we aim to formally explain the phenomenon of fast convergence of SGD observed in modern machine learning. The key observation is that most modern learning architectur…
stat.ML2017★ 31 cited
Diving into the shallows: a computational perspective on large-scale shallow learning
Siyuan Ma, Mikhail Belkin
In this paper we first identify a basic limitation in gradient descent-based optimization methods when used in conjunctions with smooth kernels. An analysis based on the spectral p…