Conditional Activation for Diverse Neurons in Heterogeneous Networks

Albert Lee, Bonnie Lam, Wenyuan Li +4

In this paper, we propose a new scheme for modelling the diverse behavior of neurons. We introduce the conditional activation, in which a neurons activation function is dynamically…