Quantifying Model Complexity via Functional Decomposition for Better Post-Hoc Interpretability

Abstract

Post-hoc model-agnostic interpretation methods such as partial dependence plots can be employed to interpret complex machine learning models. While these interpretation methods can be applied regardless of model complexity, they can produce misleading and verbose results if the model is too complex, especially w.r.t. feature interactions. To quantify the complexity of arbitrary machine learning models, we propose model-agnostic complexity measures based on functional decomposition: number of features used, interaction strength and main effect complexity. We show that post-hoc interpretation of models that minimize the three measures is more reliable and compact. Furthermore, we demonstrate the application of these measures in a multi-objective optimization approach which simultaneously minimizes loss and complexity.

References in corpus (10)

• Towards A Rigorous Science of Interpretable Machine Learning
• All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously
• Model-Agnostic Interpretability of Machine Learning
• Supersparse Linear Integer Models for Optimized Medical Scoring Systems
• Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models
• Visualizing the Feature Importance for Black Box Models
• Assessing the Local Interpretability of Machine Learning Models
• Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead
• Regularizing Black-box Models for Improved Interpretability
• TIP: Typifying the Interpretability of Procedures

Cited by in corpus (8)

• The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategies
• Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challenges
• Towards Quantification of Explainability in Explainable Artificial Intelligence Methods
• Machine Learning Workflow to Explain Black-box Models for Early Alzheimer's Disease Classification Evaluated for Multiple Datasets
• Proposed Guidelines for the Responsible Use of Explainable Machine Learning
• Multi-Objective Automatic Machine Learning with AutoxgboostMC
• Disentangled Attribution Curves for Interpreting Random Forests and Boosted Trees
• Mind the Gap: Measuring Generalization Performance Across Multiple Objectives