Interpretability of machine learning based prediction models in healthcare

Abstract

There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models allow healthcare experts to make reasonable and data-driven decisions to provide personalized decisions that can ultimately lead to higher quality of service in healthcare. Generally, we can classify interpretability approaches in two groups where the first focuses on personalized interpretation (local interpretability) while the second summarizes prediction models on a population level (global interpretability). Alternatively, we can group interpretability methods into model-specific techniques, which are designed to interpret predictions generated by a specific model, such as a neural network, and model-agnostic approaches, which provide easy-to-understand explanations of predictions made by any machine learning model. Here, we give an overview of interpretability approaches and provide examples of practical interpretability of machine learning in different areas of healthcare, including prediction of health-related outcomes, optimizing treatments or improving the efficiency of screening for specific conditions. Further, we outline future directions for interpretable machine learning and highlight the importance of developing algorithmic solutions that can enable machine-learning driven decision making in high-stakes healthcare problems.

arXiv comment12 pages, 2 figures, published in Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

References in corpus (6)

• Distilling the Knowledge in a Neural Network
• Interpretable machine learning: definitions, methods, and applications
• Model-Agnostic Interpretability of Machine Learning
• RetainVis: Visual Analytics with Interpretable and Interactive Recurrent Neural Networks on Electronic Medical Records
• "What is Relevant in a Text Document?": An Interpretable Machine Learning Approach
• The State of the Art in Integrating Machine Learning into Visual Analytics

Cited by in corpus (16)

• Model-agnostic Feature Importance and Effects with Dependent Features -- A Conditional Subgroup Approach
• Development and evaluation of an Explainable Prediction Model for Chronic Kidney Disease Patients based on Ensemble Trees
• Development and validation of an interpretable machine learning-based calculator for predicting 5-year weight trajectories after bariatric surgery: a multinational retrospective cohort SOPHIA study
• Improvement of a Prediction Model for Heart Failure Survival through Explainable Artificial Intelligence
• Directive Explanations for Monitoring the Risk of Diabetes Onset: Introducing Directive Data-Centric Explanations and Combinations to Support What-If Explorations
• Graph-guided random forest for gene set selection
• Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation System
• Hypothesis Testing and Machine Learning: Interpreting Variable Effects in Deep Artificial Neural Networks using Cohen's f2
• When and How to Fool Explainable Models (and Humans) with Adversarial Examples
• I-SPLIT: Deep Network Interpretability for Split Computing
• Interpretable machine learning for time-to-event prediction in medicine and healthcare
• SERF: Interpretable Sleep Staging using Embeddings, Rules, and Features
• Multi-Scale Grouped Prototypes for Interpretable Semantic Segmentation
• Comprehensive Evaluation of Prototype Neural Networks
• Designing Visual Explanations and Learner Controls to Engage Adolescents in AI-Supported Exercise Selection
• MoE-Enhanced Explainable Deep Manifold Transformation for Complex Data Embedding and Visualization