52 citations · 104 across the 8 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2020★ 1 cited
Contrastive Weight Regularization for Large Minibatch SGD
Qiwei Yuan, Weizhe Hua, Yi Zhou +1
The minibatch stochastic gradient descent method (SGD) is widely applied in deep learning due to its efficiency and scalability that enable training deep networks with a large volu…
cs.LG2020★ 52 cited
Normalization Techniques in Training DNNs: Methodology, Analysis and Application
Lei Huang, Jie Qin, Yi Zhou +3
Normalization techniques are essential for accelerating the training and improving the generalization of deep neural networks (DNNs), and have successfully been used in various app…