Comparison of non-linear activation functions for deep neural networks on MNIST classification task

Dabal Pedamonti

Activation functions play a key role in neural networks so it becomes fundamental to understand their advantages and disadvantages in order to achieve better performances. This pap…