384 citations · 1.3k across the 26 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 5 cited
Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data
Spencer Frei, Gal Vardi, Peter L. Bartlett +2
The implicit biases of gradient-based optimization algorithms are conjectured to be a major factor in the success of modern deep learning. In this work, we investigate the implicit…
cs.LG2022★ 8 cited
More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize
Alexander Wei, Wei Hu, Jacob Steinhardt
Of theories for why large-scale machine learning models generalize despite being vastly overparameterized, which of their assumptions are needed to capture the qualitative phenomen…