54 citations · 251 across the 28 of their papers we have counts for
Showing 2021 · cs.LGShow all
2 papers · 2 filters
cs.LG2021★ 18 cited
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark
Shiv Ram Dubey, Satish Kumar Singh, Bidyut Baran Chaudhuri
Neural networks have shown tremendous growth in recent years to solve numerous problems. Various types of neural networks have been introduced to deal with different types of probl…
cs.LG2021★ 1 cited
AdaInject: Injection Based Adaptive Gradient Descent Optimizers for Convolutional Neural Networks
Shiv Ram Dubey, S. H. Shabbeer Basha, Satish Kumar Singh +1
The convolutional neural networks (CNNs) are generally trained using stochastic gradient descent (SGD) based optimization techniques. The existing SGD optimizers generally suffer w…