507 citations · 672 across the 27 of their papers we have counts for
Showing 2017 · cs.CVShow all
2 papers · 2 filters
cs.CV2017★ 56 cited
Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification
Igor Gitman, Boris Ginsburg
Batch normalization (BN) has become a de facto standard for training deep convolutional networks. However, BN accounts for a significant fraction of training run-time and is diffic…
cs.CV2017★ 507 cited
Large Batch Training of Convolutional Networks
Yang You, Igor Gitman, Boris Ginsburg
A common way to speed up training of large convolutional networks is to add computational units. Training is then performed using data-parallel synchronous Stochastic Gradient Desc…