82 citations · 92 across the 7 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020★ 82 cited
Discovering Parametric Activation Functions
Garrett Bingham, Risto Miikkulainen
Recent studies have shown that the choice of activation function can significantly affect the performance of deep learning networks. However, the benefits of novel activation funct…
cs.LG2020
Evolutionary Optimization of Deep Learning Activation Functions
Garrett Bingham, William Macke, Risto Miikkulainen
The choice of activation function can have a large effect on the performance of a neural network. While there have been some attempts to hand-engineer novel activation functions, t…