996 citations · 2.4k across the 62 of their papers we have counts for
Showing cs.CVShow all
3 papers · 1 filter
cs.CV2017★ 56 cited
Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification
Igor Gitman, Boris Ginsburg
Batch normalization (BN) has become a de facto standard for training deep convolutional networks. However, BN accounts for a significant fraction of training run-time and is diffic…
cs.CV2017★ 507 cited
Large Batch Training of Convolutional Networks
Yang You, Igor Gitman, Boris Ginsburg
A common way to speed up training of large convolutional networks is to add computational units. Training is then performed using data-parallel synchronous Stochastic Gradient Desc…
cs.CV2016
SEBOOST - Boosting Stochastic Learning Using Subspace Optimization Techniques
Elad Richardson, Rom Herskovitz, Boris Ginsburg +1
We present SEBOOST, a technique for boosting the performance of existing stochastic optimization methods. SEBOOST applies a secondary optimization process in the subspace spanned b…