Impact Assessment of Missing Data in Model Predictions for Earth Observation Applications

Abstract

Earth observation (EO) applications involving complex and heterogeneous data sources are commonly approached with machine learning models. However, there is a common assumption that data sources will be persistently available. Different situations could affect the availability of EO sources, like noise, clouds, or satellite mission failures. In this work, we assess the impact of missing temporal and static EO sources in trained models across four datasets with classification and regression tasks. We compare the predictive quality of different methods and find that some are naturally more robust to missing data. The Ensemble strategy, in particular, achieves a prediction robustness up to 100%. We evidence that missing scenarios are significantly more challenging in regression than classification tasks. Finally, we find that the optical view is the most critical view when it is missing individually.

Accepted at IEEE International Geoscience and Remote Sensing Symposium 2024

References in corpus (4)

• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• Understanding urban landuse from the above and ground perspectives: a deep learning, multimodal solution
• Common Practices and Taxonomy in Deep Multi-view Fusion for Remote Sensing Applications
• A Comparative Assessment of Multi-view fusion learning for Crop Classification

Cited by in corpus (1)

• On What Depends the Robustness of Multi-source Models to Missing Data in Earth Observation?