507 citations · 1k across the 22 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019★ 162 cited
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes
Yang You, Jing Li, Sashank Reddi +7
Training large deep neural networks on massive datasets is computationally very challenging. There has been recent surge in interest in using large batch stochastic optimization me…
cs.LG2019★ 12 cited
Large-Batch Training for LSTM and Beyond
Yang You, Jonathan Hseu, Chris Ying +3
Large-batch training approaches have enabled researchers to utilize large-scale distributed processing and greatly accelerate deep-neural net (DNN) training. For example, by scalin…