Relative Feature Importance

Abstract

Interpretable Machine Learning (IML) methods are used to gain insight into the relevance of a feature of interest for the performance of a model. Commonly used IML methods differ in whether they consider features of interest in isolation, e.g., Permutation Feature Importance (PFI), or in relation to all remaining feature variables, e.g., Conditional Feature Importance (CFI). As such, the perturbation mechanisms inherent to PFI and CFI represent extreme reference points. We introduce Relative Feature Importance (RFI), a generalization of PFI and CFI that allows for a more nuanced feature importance computation beyond the PFI versus CFI dichotomy. With RFI, the importance of a feature relative to any other subset of features can be assessed, including variables that were not available at training time. We derive general interpretation rules for RFI based on a detailed theoretical analysis of the implications of relative feature relevance, and demonstrate the method's usefulness on simulated examples.

References in corpus (4)

• Fully Convolutional Networks for Semantic Segmentation
• All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously
• Generative and Discriminative Voxel Modeling with Convolutional Neural Networks
• Understanding Global Feature Contributions With Additive Importance Measures

Cited by in corpus (5)

• Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challenges
• Enhance to Read Better: A Multi-Task Adversarial Network for Handwritten Document Image Enhancement
• Advanced Underwater Image Restoration in Complex Illumination Conditions
• Exploiting auto-encoders and segmentation methods for middle-level explanations of image classification systems
• Explanations Based on Item Response Theory (eXirt): A Model-Specific Method to Explain Tree-Ensemble Model in Trust Perspective