Accelerating Hessian-free optimization for deep neural networks by implicit preconditioning and sampling

Tara N. Sainath, Lior Horesh, Brian Kingsbury +2

Hessian-free training has become a popular parallel second or- der optimization technique for Deep Neural Network training. This study aims at speeding up Hessian-free training, bo…