10 citations · 26 across the 14 of their papers we have counts for
3 papers · 1 filter
ErfAct and Pserf: Non-monotonic Smooth Trainable Activation Functions
Koushik Biswas, Sandeep Kumar, Shilpak Banerjee +1
An activation function is a crucial component of a neural network that introduces non-linearity in the network. The state-of-the-art performance of a neural network depends also on…
Orthogonal-Padé Activation Functions: Trainable Activation functions for smooth and faster convergence in deep networks
Koushik Biswas, Shilpak Banerjee, Ashish Kumar Pandey
We have proposed orthogonal-Padé activation functions, which are trainable activation functions and show that they have faster learning capability and improves the accuracy in stan…
TanhSoft -- a family of activation functions combining Tanh and Softplus
Koushik Biswas, Sandeep Kumar, Shilpak Banerjee +1
Deep learning at its core, contains functions that are composition of a linear transformation with a non-linear function known as activation function. In past few years, there is a…