EIS -- a family of activation functions combining Exponential, ISRU, and Softplus

Koushik Biswas, Sandeep Kumar, Shilpak Banerjee +1

Activation functions play a pivotal role in the function learning using neural networks. The non-linearity in the learned function is achieved by repeated use of the activation fun…