OCP-GN: A Scalable Second-order Optimizer for Stochastic Optimization

Jindi Zhong, Congyaohui Yin, Zhaorong Zhang +1

This paper proposes a novel second-order optimization algorithm based on the Optimal Control Principle (OCP), applicable to large-scale optimization problems in neural network trai…