10 citations · 40 across the 17 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.LG2020★ 10 cited
Batch Group Normalization
Xiao-Yun Zhou, Jiacheng Sun, Nanyang Ye +6
Deep Convolutional Neural Networks (DCNNs) are hard and time-consuming to train. Normalization is one of the effective solutions. Among previous normalization methods, Batch Normal…
cs.LG2020
A Practical Layer-Parallel Training Algorithm for Residual Networks
Qi Sun, Hexin Dong, Zewei Chen +5
Gradient-based algorithms for training ResNets typically require a forward pass of the input data, followed by back-propagating the objective gradient to update parameters, which a…
cs.LG2020
New Interpretations of Normalization Methods in Deep Learning
Jiacheng Sun, Xiangyong Cao, Hanwen Liang +3
In recent years, a variety of normalization methods have been proposed to help train neural networks, such as batch normalization (BN), layer normalization (LN), weight normalizati…