Evaluation of Saliency-based Explainability Method

Abstract

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an intuitive way for users to understand predictions made by CNNs. Other than quantitative computational tests, the vast majority of evidence to highlight that the methods are valuable is anecdotal. Given that humans would be the end-users of such methods, we devise three human subject experiments through which we gauge the effectiveness of these saliency-based explainability methods.

arXiv commentAccepted at the ICML Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI, 2021

References in corpus (7)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Axiomatic Attribution for Deep Networks
• Learning Important Features Through Propagating Activation Differences
• SmoothGrad: removing noise by adding noise
• Sanity Checks for Saliency Maps
• Full-Gradient Representation for Neural Network Visualization
• Quantitative Evaluations on Saliency Methods: An Experimental Study