14 citations · 23 across the 6 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.DC2021★ 2 cited
Varuna: Scalable, Low-cost Training of Massive Deep Learning Models
Sanjith Athlur, Nitika Saran, Muthian Sivathanu +2
Systems for training massive deep learning models (billions of parameters) today assume and require specialized "hyper-clusters": hundreds or thousands of GPUs wired with specializ…
cs.LG2021
LRTuner: A Learning Rate Tuner for Deep Neural Networks
Nikhil Iyer, V Thejas, Nipun Kwatra +2
One very important hyperparameter for training deep neural networks is the learning rate schedule of the optimizer. The choice of learning rate schedule determines the computationa…