A Survey on Activation Functions and their relation with Xavier and He Normal Initialization

Leonid Datta

In artificial neural network, the activation function and the weight initialization method play important roles in training and performance of a neural network. The question arises…