Calibrating Healthcare AI: Towards Reliable and Interpretable Deep Predictive Models

Abstract

The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior. While the former need is often addressed by incorporating uncertainty quantification strategies, the latter challenge is addressed using a broad class of interpretability techniques. In this paper, we argue that these two objectives are not necessarily disparate and propose to utilize prediction calibration to meet both objectives. More specifically, our approach is comprised of a calibration-driven learning method, which is also used to design an interpretability technique based on counterfactual reasoning. Furthermore, we introduce \textit{reliability plots}, a holistic evaluation mechanism for model reliability. Using a lesion classification problem with dermoscopy images, we demonstrate the effectiveness of our approach and infer interesting insights about the model behavior.

References in corpus (7)

• Methods for Interpreting and Understanding Deep Neural Networks
• Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
• One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
• What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use
• Multifaceted Feature Visualization: Uncovering the Different Types of Features Learned By Each Neuron in Deep Neural Networks
• Reliable Decision Support using Counterfactual Models
• Who wants accurate models? Arguing for a different metrics to take classification models seriously

Cited by in corpus (5)

• Active learning of deep surrogates for PDEs: Application to metasurface design
• Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions
• Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
• Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detection
• On the Calibration and Uncertainty of Neural Learning to Rank Models