4 citations · 6 across the 3 of their papers we have counts for
3 papers
stat.ML2020★ 1 cited
Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
Shen-Yi Zhao, Chang-Wei Shi, Yin-Peng Xie +1
Stochastic gradient descent~(SGD) and its variants have been the dominating optimization methods in machine learning. Compared to SGD with small-batch training, SGD with large-batc…
stat.ML2020★ 4 cited
Stagewise Enlargement of Batch Size for SGD-based Learning
Shen-Yi Zhao, Yin-Peng Xie, Wu-Jun Li
Existing research shows that the batch size can seriously affect the performance of stochastic gradient descent~(SGD) based learning, including training speed and generalization ab…
stat.ML2019★ 1 cited
Global Momentum Compression for Sparse Communication in Distributed Learning
Chang-Wei Shi, Shen-Yi Zhao, Yin-Peng Xie +2
With the rapid growth of data, distributed momentum stochastic gradient descent~(DMSGD) has been widely used in distributed learning, especially for training large-scale deep model…