A Stochastic Variance Reduced Nesterov's Accelerated Quasi-Newton Method

Sota Yasuda, Shahrzad Mahboubi, S. Indrapriyadarsini +2

Recently algorithms incorporating second order curvature information have become popular in training neural networks. The Nesterov's Accelerated Quasi-Newton (NAQ) method has shown…