Understanding Neural Networks and Individual Neuron Importance via Information-Ordered Cumulative Ablation

Rana Ali Amjad, Kairen Liu, Bernhard C. Geiger

In this work, we investigate the use of three information-theoretic quantities -- entropy, mutual information with the class variable, and a class selectivity measure based on Kull…