Understanding Two-Layer Neural Networks with Smooth Activation Functions

Changcun Huang

This paper aims to understand the training solution, which is obtained by the back-propagation algorithm, of two-layer neural networks whose hidden layer is composed of the units w…