On the Principles of ReLU Networks with One Hidden Layer

Changcun Huang

A neural network with one hidden layer or a two-layer network (regardless of the input layer) is the simplest feedforward neural network, whose mechanism may be the basis of more g…