21 citations · 21 across the 1 of their papers we have counts for
1 paper
Rostislav Goroshin, Yann LeCun
We introduce a simple new regularizer for auto-encoders whose hidden-unit activation functions contain at least one zero-gradient (saturated) region. This regularizer explicitly en…