106 citations · 197 across the 33 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
stat.ML2022★ 4 cited
The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes
Alexander Atanasov, Blake Bordelon, Sabarish Sainathan +1
For small training set sizes , the generalization error of wide neural networks is well-approximated by the error of an infinite width neural network (NN), either in the kernel…
stat.ML2022★ 7 cited
The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks
Blake Bordelon, Cengiz Pehlevan
It is unclear how changing the learning rule of a deep neural network alters its learning dynamics and representations. To gain insight into the relationship between learned featur…
stat.ML2022★ 18 cited
Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks
Blake Bordelon, Cengiz Pehlevan
We analyze feature learning in infinite-width neural networks trained with gradient flow through a self-consistent dynamical field theory. We construct a collection of deterministi…