Convolutional Neural Network Training with Distributed K-FAC

J. Gregory Pauloski, Zhao Zhang, Lei Huang +2

Training neural networks with many processors can reduce time-to-solution; however, it is challenging to maintain convergence and efficiency at large scales. The Kronecker-factored…