Random deep neural networks are biased towards simple functions

Giacomo De Palma, Bobak Toussi Kiani, Seth Lloyd

We prove that the binary classifiers of bit strings generated by random wide deep neural networks with ReLU activation function are biased towards simple functions. The simplicity…