Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing

Abstract

In recent years, black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in remote sensing. Despite the potential benefits of uncovering the inner workings of these models with explainable AI, a comprehensive overview summarizing the explainable AI methods used and their objectives, findings, and challenges in remote sensing applications is still missing. In this paper, we address this gap by performing a systematic review to identify the key trends in the field and shed light on novel explainable AI approaches and emerging directions that tackle specific remote sensing challenges. We also reveal the common patterns of explanation interpretation, discuss the extracted scientific insights, and reflect on the approaches used for the evaluation of explainable AI methods. As such, our review provides a complete summary of the state-of-the-art of explainable AI in remote sensing. Further, we give a detailed outlook on the challenges and promising research directions, representing a basis for novel methodological development and a useful starting point for new researchers in the field.

References in corpus (7)

• Deep learning in remote sensing: a review
• Prototype selection for interpretable classification
• GLocalX -- From Local to Global Explanations of Black Box AI Models
• Deep Learning for Satellite Image Time Series Analysis: A Review
• Towards a Collective Agenda on AI for Earth Science Data Analysis
• Enabling Explainable Fusion in Deep Learning with Fuzzy Integral Neural Networks
• Explaining and Interpreting LSTMs

Cited by in corpus (2)

• Meta-evaluating stability measures: MAX-Senstivity & AVG-Sensitivity
• Survey on Remote Sensing Scene Classification: From Traditional Methods to Large Generative AI Models