3 papers
cs.LG2026
On the Principles of Deep Feedforward ReLU Networks
Changcun Huang
The architecture of deep feedforward neural networks is ubiquitous in deep learning, either as a whole system or as a subnetwork of other architectures, and thus its mechanism is a…
cs.LG2026
Understanding Two-Layer Neural Networks with Smooth Activation Functions
Changcun Huang
This paper aims to understand the training solution, which is obtained by the back-propagation algorithm, of two-layer neural networks whose hidden layer is composed of the units w…
cs.LG2025
On the Principles of ReLU Networks with One Hidden Layer
Changcun Huang
A neural network with one hidden layer or a two-layer network (regardless of the input layer) is the simplest feedforward neural network, whose mechanism may be the basis of more g…