12 citations · 12 across the 1 of their papers we have counts for
2 papers
cs.LG2019
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
Yang You, Jing Li, Sashank Reddi +7
Training large deep neural networks on massive datasets is computationally very challenging. There has been recent surge in interest in using large batch stochastic optimization me…
cs.LG2019★ 12 cited
Large-Batch Training for LSTM and Beyond
Yang You, Jonathan Hseu, Chris Ying +3
Large-batch training approaches have enabled researchers to utilize large-scale distributed processing and greatly accelerate deep-neural net (DNN) training. For example, by scalin…