First Demonstration of Second-order Training of Deep Neural Networks with In-memory Analog Matrix Computing

Saitao Zhang, Yubiao Luo, Shiqing Wang +5

Second-order optimization methods, which leverage curvature information, offer faster and more stable convergence than first-order methods such as stochastic gradient descent (SGD)…