Deep learning improved by biological activation functions

Gardave S Bhumbra

`Biologically inspired' activation functions, such as the logistic sigmoid, have been instrumental in the historical advancement of machine learning. However in the field of deep l…