3.9k citations · 17.4k across the 35 of their papers we have counts for
Showing cs.NEShow all
2 papers · 1 filter
cs.NE2018★ 7 cited
Backprop Evolution
Maximilian Alber, Irwan Bello, Barret Zoph +3
The back-propagation algorithm is the cornerstone of deep learning. Despite its importance, few variations of the algorithm have been attempted. This work presents an approach to d…
cs.NE2017★ 753 cited
Searching for Activation Functions
Prajit Ramachandran, Barret Zoph, Quoc V. Le
The choice of activation functions in deep networks has a significant effect on the training dynamics and task performance. Currently, the most successful and widely-used activatio…