Optimizing Performance of Feedforward and Convolutional Neural Networks through Dynamic Activation Functions

Chinmay Rane, Kanishka Tyagi, Michael Manry

Deep learning training training algorithms are a huge success in recent years in many fields including speech, text,image video etc. Deeper and deeper layers are proposed with huge…