Scientific Inference With Interpretable Machine Learning: Analyzing Models to Learn About Real-World Phenomena

Abstract

To learn about real world phenomena, scientists have traditionally used models with clearly interpretable elements. However, modern machine learning (ML) models, while powerful predictors, lack this direct elementwise interpretability (e.g. neural network weights). Interpretable machine learning (IML) offers a solution by analyzing models holistically to derive interpretations. Yet, current IML research is focused on auditing ML models rather than leveraging them for scientific inference. Our work bridges this gap, presenting a framework for designing IML methods-termed 'property descriptors' -- that illuminate not just the model, but also the phenomenon it represents. We demonstrate that property descriptors, grounded in statistical learning theory, can effectively reveal relevant properties of the joint probability distribution of the observational data. We identify existing IML methods suited for scientific inference and provide a guide for developing new descriptors with quantified epistemic uncertainty. Our framework empowers scientists to harness ML models for inference, and provides directions for future IML research to support scientific understanding.

The paper has been published at "Minds and Machines" and is accessible at https://doi.org/10.1007/s11023-024-09691-z

References in corpus (19)

• Towards A Rigorous Science of Interpretable Machine Learning
• To Explain or to Predict?
• Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challenges
• Strong Completeness and Faithfulness in Bayesian Networks
• Feature relevance quantification in explainable AI: A causal problem
• Relating the Partial Dependence Plot and Permutation Feature Importance to the Data Generating Process
• Demystifying statistical learning based on efficient influence functions
• The no-free-lunch theorems of supervised learning
• CXPlain: Causal Explanations for Model Interpretation under Uncertainty
• A Double Machine Learning Trend Model for Citizen Science Data
• A Guide to Feature Importance Methods for Scientific Inference
• Shapley Flow: A Graph-based Approach to Interpreting Model Predictions
• Causal Reinforcement Learning using Observational and Interventional Data
• Emergence of Concepts in DNNs?
• Improvement-Focused Causal Recourse (ICR)
• Explaining Hyperparameter Optimization via Partial Dependence Plots
• Generating Interpretable Counterfactual Explanations By Implicit Minimisation of Epistemic and Aleatoric Uncertainties
• Artificial Neural Nets and the Representation of Human Concepts
• DeDUCE: Generating Counterfactual Explanations Efficiently