Activation Functions: Do They Represent A Trade-Off Between Modular Nature of Neural Networks And Task Performance

Himanshu Pradeep Aswani, Amit Sethi

Current research suggests that the key factors in designing neural network architectures involve choosing number of filters for every convolution layer, number of hidden neurons fo…