616 citations · 974 across the 6 of their papers we have counts for
1 paper · 1 filter
Jonathan T. Barron
We present squareplus, an activation function that resembles softplus, but which can be computed using only algebraic operations: addition, multiplication, and square-root. Because…