10 citations · 26 across the 14 of their papers we have counts for
3 papers · 1 filter
SMU: smooth activation function for deep networks using smoothing maximum technique
Koushik Biswas, Sandeep Kumar, Shilpak Banerjee +1
Deep learning researchers have a keen interest in proposing two new novel activation functions which can boost network performance. A good choice of activation function can have si…
SAU: Smooth activation function using convolution with approximate identities
Koushik Biswas, Sandeep Kumar, Shilpak Banerjee +1
Well-known activation functions like ReLU or Leaky ReLU are non-differentiable at the origin. Over the years, many smooth approximations of ReLU have been proposed using various sm…
EIS -- a family of activation functions combining Exponential, ISRU, and Softplus
Koushik Biswas, Sandeep Kumar, Shilpak Banerjee +1
Activation functions play a pivotal role in the function learning using neural networks. The non-linearity in the learned function is achieved by repeated use of the activation fun…