Fisher Information and Natural Gradient Learning of Random Deep Networks

Shun-ichi Amari, Ryo Karakida, Masafumi Oizumi

A deep neural network is a hierarchical nonlinear model transforming input signals to output signals. Its input-output relation is considered to be stochastic, being described for…