54 citations · 251 across the 28 of their papers we have counts for
3 papers · 1 filter
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark
Shiv Ram Dubey, Satish Kumar Singh, Bidyut Baran Chaudhuri
Neural networks have shown tremendous growth in recent years to solve numerous problems. Various types of neural networks have been introduced to deal with different types of probl…
AdaInject: Injection Based Adaptive Gradient Descent Optimizers for Convolutional Neural Networks
Shiv Ram Dubey, S. H. Shabbeer Basha, Satish Kumar Singh +1
The convolutional neural networks (CNNs) are generally trained using stochastic gradient descent (SGD) based optimization techniques. The existing SGD optimizers generally suffer w…
diffGrad: An Optimization Method for Convolutional Neural Networks
Shiv Ram Dubey, Soumendu Chakraborty, Swalpa Kumar Roy +3
Stochastic Gradient Decent (SGD) is one of the core techniques behind the success of deep neural networks. The gradient provides information on the direction in which a function ha…