On the special role of class-selective neurons in early training

Omkar Ranadive, Nikhil Thakurdesai, Ari S Morcos +2

It is commonly observed that deep networks trained for classification exhibit class-selective neurons in their early and intermediate layers. Intriguingly, recent studies have show…