5 citations · 9 across the 3 of their papers we have counts for
3 papers
SwishReLU: A Unified Approach to Activation Functions for Enhanced Deep Neural Networks Performance
Jamshaid Ul Rahman, Rubiqa Zulfiqar, Asad Khan +1
ReLU, a commonly used activation function in deep neural networks, is prone to the issue of "Dying ReLU". Several enhanced versions, such as ELU, SeLU, and Swish, have been introdu…
ASU-CNN: An Efficient Deep Architecture for Image Classification and Feature Visualizations
Jamshaid Ul Rahman, Faiza Makhdoom, Dianchen Lu
Activation functions play a decisive role in determining the capacity of Deep Neural Networks as they enable neural networks to capture inherent nonlinearities present in data fed…
Amplifying Sine Unit: An Oscillatory Activation Function for Deep Neural Networks to Recover Nonlinear Oscillations Efficiently
Jamshaid Ul Rahman, Faiza Makhdoom, Dianchen Lu
Many industrial and real life problems exhibit highly nonlinear periodic behaviors and the conventional methods may fall short of finding their analytical or closed form solutions.…