ProbAct: A Probabilistic Activation Function for Deep Neural Networks

Kumar Shridhar, Joonho Lee, Hideaki Hayashi +6

Activation functions play an important role in training artificial neural networks. The majority of currently used activation functions are deterministic in nature, with their fixe…