517 citations · 1.1k across the 28 of their papers we have counts for
4 papers · 1 filter
The generalization error of random features regression: Precise asymptotics and double descent curve
Song Mei, Andrea Montanari
Deep learning methods operate in regimes that defy the traditional statistical mindset. Neural network architectures often contain more parameters than training samples, and are so…
Limitations of Lazy Training of Two-layers Neural Networks
Behrooz Ghorbani, Song Mei, Theodor Misiakiewicz +1
We study the supervised learning problem under either of the following two models: (1) Feature vectors are -dimensional Gaussians and responses are $y_i = f_…
Proximal algorithms for constrained composite optimization, with applications to solving low-rank SDPs
Yu Bai, John Duchi, Song Mei
We study a family of (potentially non-convex) constrained optimization problems with convex composite structure. Through a novel analysis of non-smooth geometry, we show that proxi…
Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit
Song Mei, Theodor Misiakiewicz, Andrea Montanari
We consider learning two layer neural networks using stochastic gradient descent. The mean-field description of this learning dynamics approximates the evolution of the network wei…