Benchmarking Neural Network Training Algorithms

George E. Dahl, Frank Schneider, Zachary Nado +22

Training algorithms, broadly construed, are an essential part of every deep learning pipeline. Training algorithm improvements that speed up training across a wide variety of workl…