Infinitely deep neural networks as diffusion processes

Stefano Peluchetti, Stefano Favaro

When the parameters are independently and identically distributed (initialized) neural networks exhibit undesirable properties that emerge as the number of layers increases, e.g. a…