SLISEMAP: Supervised dimensionality reduction through local explanations
arXiv:2201.04455 · doi:10.1007/s10994-022-06261-1
Abstract
Existing methods for explaining black box learning models often focus on building local explanations of model behaviour for a particular data item. It is possible to create global explanations for all data items, but these explanations generally have low fidelity for complex black box models. We propose a new supervised manifold visualisation method, SLISEMAP, that simultaneously finds local explanations for all data items and builds a (typically) two-dimensional global visualisation of the black box model such that data items with similar local explanations are projected nearby. We provide a mathematical derivation of our problem and an open source implementation implemented using the GPU-optimised PyTorch library. We compare SLISEMAP to multiple popular dimensionality reduction methods and find that SLISEMAP is able to utilise labelled data to create embeddings with consistent local white box models. We also compare SLISEMAP to other model-agnostic local explanation methods and show that SLISEMAP provides comparable explanations and that the visualisations can give a broader understanding of black box regression and classification models.
26 pages, 10 figures, 3 tables. This revision replaces the parameter with , which is more intuitive and stable. There are also many typographical and clarity improvements. The source code for our implementation of the algorithm (and the experiments) are available from GitHub at https://github.com/edahelsinki/slisemap . Machine Learning (2022)