most citedThe Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes

4 citations · 7 across the 2 of their papers we have counts for

collaborators

2 papers

cs.LG2023★ 3 cited

Feature-Learning Networks Are Consistent Across Widths At Realistic Scales

Nikhil Vyas, Alexander Atanasov, Blake Bordelon +3

We study the effect of width on the dynamics of feature-learning neural networks across a variety of architectures and datasets. Early in training, wide neural networks trained on…

stat.ML2022★ 4 cited

The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes

Alexander Atanasov, Blake Bordelon, Sabarish Sainathan +1

For small training set sizes , the generalization error of wide neural networks is well-approximated by the error of an infinite width neural network (NN), either in the kernel…