Understanding Locally Competitive Networks

Rupesh Kumar Srivastava, Jonathan Masci, Faustino Gomez +1

Recently proposed neural network activation functions such as rectified linear, maxout, and local winner-take-all have allowed for faster and more effective training of deep neural…