91 citations · 173 across the 10 of their papers we have counts for
3 papers · 1 filter
Learning with invariances in random features and kernel models
Song Mei, Theodor Misiakiewicz, Andrea Montanari
A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For inst…
Limitations of Lazy Training of Two-layers Neural Networks
Behrooz Ghorbani, Song Mei, Theodor Misiakiewicz +1
We study the supervised learning problem under either of the following two models: (1) Feature vectors are -dimensional Gaussians and responses are $y_i = f_…
Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit
Song Mei, Theodor Misiakiewicz, Andrea Montanari
We consider learning two layer neural networks using stochastic gradient descent. The mean-field description of this learning dynamics approximates the evolution of the network wei…