130 citations · 272 across the 11 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022★ 26 cited
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities
Brian R. Bartoldson, Bhavya Kailkhura, Davis Blalock
Although deep learning has made great progress in recent years, the exploding economic and environmental costs of training neural networks are becoming unsustainable. To address th…
cs.LG2022★ 1 cited
Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates
Jacob Portes, Davis Blalock, Cory Stephenson +1
Benchmarking the tradeoff between neural network accuracy and training time is computationally expensive. Here we show how a multiplicative cyclic learning rate schedule can be use…