Points of non-linearity of functions generated by random neural networks

David Holmes

We consider functions from the real numbers to the real numbers, output by a neural network with 1 hidden activation layer, arbitrary width, and ReLU activation function. We assume…