239 citations · 1.1k across the 35 of their papers we have counts for
Showing 2022 · stat.MLShow all
2 papers · 2 filters
stat.ML2022
Bayesian Interpolation with Deep Linear Networks
Boris Hanin, Alexander Zlokapa
Characterizing how neural network depth, width, and dataset size jointly impact model quality is a central problem in deep learning theory. We give here a complete solution in the…
stat.ML2022★ 3 cited
Maximal Initial Learning Rates in Deep ReLU Networks
Gaurav Iyer, Boris Hanin, David Rolnick
Training a neural network requires choosing a suitable learning rate, which involves a trade-off between speed and effectiveness of convergence. While there has been considerable t…