Activation Ensembles for Deep Neural Networks

Mark Harmon, Diego Klabjan

Many activation functions have been proposed in the past, but selecting an adequate one requires trial and error. We propose a new methodology of designing activation functions wit…