Understanding Interpretability by generalized distillation in Supervised Classification

Abstract

The ability to interpret decisions taken by Machine Learning (ML) models is fundamental to encourage trust and reliability in different practical applications. Recent interpretation strategies focus on human understanding of the underlying decision mechanisms of the complex ML models. However, these strategies are restricted by the subjective biases of humans. To dissociate from such human biases, we propose an interpretation-by-distillation formulation that is defined relative to other ML models. We generalize the distillation technique for quantifying interpretability, using an information-theoretic perspective, removing the role of ground-truth from the definition of interpretability. Our work defines the entropy of supervised classification models, providing bounds on the entropy of Piece-Wise Linear Neural Networks (PWLNs), along with the first theoretical bounds on the interpretability of PWLNs. We evaluate our proposed framework on the MNIST, Fashion-MNIST and Stanford40 datasets and demonstrate the applicability of the proposed theoretical framework in different supervised classification scenarios.

9 pages Paper + 3 pages Supplementary Material

References in corpus (9)

• Distilling the Knowledge in a Neural Network
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Towards A Rigorous Science of Interpretable Machine Learning
• Interpretable machine learning: definitions, methods, and applications
• Reconciling modern machine learning practice and the bias-variance trade-off
• On the Number of Linear Regions of Deep Neural Networks
• Complexity of Linear Regions in Deep Networks
• A Formal Framework to Characterize Interpretability of Procedures
• A Theory of Diagnostic Interpretation in Supervised Classification