Coarse-Graining Hidden Representations: Unsupervised Neuron Selection via Mapping Entropy

Margherita Mele, Andrea Castagna, Roberto Menichetti +2

Overparameterized neural networks carry far more hidden units than a task nominally requires, raising the question of which neurons are essential and whether that distinction is le…