11 citations · 13 across the 5 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.NE2023★ 2 cited
Tensor Programs VI: Feature Learning in Infinite-Depth Neural Networks
Greg Yang, Dingli Yu, Chen Zhu +1
By classifying infinite-width neural networks and identifying the *optimal* limit, Tensor Programs IV and V demonstrated a universal way, called P, for *widthwise hyperparameter…
cs.LG2023
A Spectral Condition for Feature Learning
Greg Yang, James B. Simon, Jeremy Bernstein
The push to train ever larger neural networks has motivated the study of initialization and training at large network width. A key challenge is to scale training so that a network'…