Uncertainty-aware Sensitivity Analysis Using Rényi Divergences
arXiv:1910.07942
Abstract
For nonlinear supervised learning models, assessing the importance of predictor variables or their interactions is not straightforward because it can vary in the domain of the variables. Importance can be assessed locally with sensitivity analysis using general methods that rely on the model's predictions or their derivatives. In this work, we extend derivative based sensitivity analysis to a Bayesian setting by differentiating the Rényi divergence of a model's predictive distribution. By utilising the predictive distribution instead of a point prediction, the model uncertainty is taken into account in a principled way. Our empirical results on simulated and real data sets demonstrate accurate and reliable identification of important variables and interaction effects compared to alternative methods.
References in corpus (6)
- Predictive learning via rule ensembles
- All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously
- Consistent Individualized Feature Attribution for Tree Ensembles
- A Simple and Effective Model-Based Variable Importance Measure
- Variable selection for Gaussian processes via sensitivity analysis of the posterior predictive distribution
- Learning Global Pairwise Interactions with Bayesian Neural Networks