Exact Stochastic Second Order Deep Learning

Fares B. Mehouachi, Chaouki Kasmi

Optimization in Deep Learning is mainly dominated by first-order methods which are built around the central concept of backpropagation. Second-order optimization methods, which tak…