How to Explain Neural Networks: an Approximation Perspective
arXiv:2105.07831
Abstract
The lack of interpretability has hindered the large-scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based on approximation theory in this study. We first implement this approximation interpretation on a specific model (fully connected neural network) and then propose to use MLP as a universal interpreter to explain arbitrary black-box models. Extensive experiments demonstrate the effectiveness of our approach.
References in corpus (24)
- Scikit-learn: Machine Learning in Python
- Distilling the Knowledge in a Neural Network
- Knowledge Distillation: A Survey
- Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks
- Axiomatic Attribution for Deep Networks
- Learning Important Features Through Propagating Activation Differences
- Understanding Neural Networks Through Deep Visualization
- Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
- Explaining NonLinear Classification Decisions with Deep Taylor Decomposition
- SmoothGrad: removing noise by adding noise
- Towards Robust Interpretability with Self-Explaining Neural Networks
- Distilling a Neural Network Into a Soft Decision Tree
- Deep Learning for Case-Based Reasoning through Prototypes: A Neural Network that Explains Its Predictions
- On the number of response regions of deep feed forward networks with piece-wise linear activations
- Deep ReLU Networks Have Surprisingly Few Activation Patterns
- Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks
- Explainable Artificial Intelligence: a Systematic Review
- Full-Gradient Representation for Neural Network Visualization
- Characterizing the Decision Boundary of Deep Neural Networks
- A Survey on Neural Network Interpretability
- On the Decision Boundary of Deep Neural Networks
- Empirical Studies on the Properties of Linear Regions in Deep Neural Networks
- Understanding the Decision Boundary of Deep Neural Networks: An Empirical Study
- Explaining Predictions by Approximating the Local Decision Boundary