180 citations · 339 across the 4 of their papers we have counts for
1 paper · 1 filter
Lars Eidnes, Arild Nøkland
We propose a simple extension to the ReLU-family of activation functions that allows them to shift the mean activation across a layer towards zero. Combined with proper weight init…