A robust estimator of mutual information for deep learning interpretability

Davide Piras, Hiranya V. Peiris, Andrew Pontzen +3

We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning models. To accurately estimate MI f…