IROF: a low resource evaluation metric for explanation methods
arXiv:2003.08747
Abstract
The adoption of machine learning in health care hinges on the transparency of the used algorithms, necessitating the need for explanation methods. However, despite a growing literature on explaining neural networks, no consensus has been reached on how to evaluate those explanation methods. We propose IROF, a new approach to evaluating explanation methods that circumvents the need for manual evaluation. Compared to other recent work, our approach requires several orders of magnitude less computational resources and no human input, making it accessible to lower resource groups and robust to human bias.
References in corpus (8)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Axiomatic Attribution for Deep Networks
- Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
- Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
- SmoothGrad: removing noise by adding noise
- Sanity Checks for Saliency Maps
- A Benchmark for Interpretability Methods in Deep Neural Networks
- "Why Should You Trust My Explanation?" Understanding Uncertainty in LIME Explanations