Convergence of neural networks to Gaussian mixture distribution

Yasuhiko Asao, Ryotaro Sakamoto, Shiro Takagi

We give a proof that, under relatively mild conditions, fully-connected feed-forward deep random neural networks converge to a Gaussian mixture distribution as only the width of th…