An Analysis of State-of-the-art Activation Functions For Supervised Deep Neural Network

Anh Nguyen, Khoa Pham, Dat Ngo +2

This paper provides an analysis of state-of-the-art activation functions with respect to supervised classification of deep neural network. These activation functions comprise of Re…