Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

Abstract

Cloud detection is an important preprocessing step for the precise application of optical satellite imagery. In this paper, we propose a deep learning based cloud detection method named multi-scale convolutional feature fusion (MSCFF) for remote sensing images of different sensors. In the network architecture of MSCFF, the symmetric encoder-decoder module, which provides both local and global context by densifying feature maps with trainable convolutional filter banks, is utilized to extract multi-scale and high-level spatial features. The feature maps of multiple scales are then up-sampled and concatenated, and a novel multi-scale feature fusion module is designed to fuse the features of different scales for the output. The two output feature maps of the network are cloud and cloud shadow maps, which are in turn fed to binary classifiers outside the model to obtain the final cloud and cloud shadow mask. The MSCFF method was validated on hundreds of globally distributed optical satellite images, with spatial resolutions ranging from 0.5 to 50 m, including Landsat-5/7/8, Gaofen-1/2/4, Sentinel-2, Ziyuan-3, CBERS-04, Huanjing-1, and collected high-resolution images exported from Google Earth. The experimental results show that MSCFF achieves a higher accuracy than the traditional rule-based cloud detection methods and the state-of-the-art deep learning models, especially in bright surface covered areas. The effectiveness of MSCFF means that it has great promise for the practical application of cloud detection for multiple types of medium and high-resolution remote sensing images. Our established global high-resolution cloud detection validation dataset has been made available online.

arXiv commentThis manuscript has been accepted for publication in ISPRS Journal of Photogrammetry and Remote Sensing, vol. 150, pp.197-212, 2019. (https://doi.org/10.1016/j.isprsjprs.2019.02.017)

References in corpus (5)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Deep learning in remote sensing: a review
• A guide to convolution arithmetic for deep learning
• Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imagery
• Convolutional Neural Networks for Multispectral Image Cloud Masking

Cited by in corpus (14)

• Machine Learning Information Fusion in Earth Observation: A Comprehensive Review of Methods, Applications and Data Sources
• An Urban Water Extraction Method Combining Deep Learning and Google Earth Engine
• Machine Learning and Big Scientific Data
• Cloud and Cloud Shadow Segmentation for Remote Sensing Imagery via Filtered Jaccard Loss Function and Parametric Augmentation
• A lightweight deep learning based cloud detection method for Sentinel-2A imagery fusing multi-scale spectral and spatial features
• Convolutional LSTMs for Cloud-Robust Segmentation of Remote Sensing Imagery
• Nonlocal Patch-Based Fully-Connected Tensor Network Decomposition for Remote Sensing Image Inpainting
• MUS-CDB: Mixed Uncertainty Sampling with Class Distribution Balancing for Active Annotation in Aerial Object Detection
• SEnSeI: A Deep Learning Module for Creating Sensor Independent Cloud Masks
• Cross-Sensor Adversarial Domain Adaptation of Landsat-8 and Proba-V images for Cloud Detection
• Geographical Knowledge-driven Representation Learning for Remote Sensing Images
• Rapid Automated Mapping of Clouds on Titan With Instance Segmentation
• Saliency Driven Imagery Preprocessing for Efficient Compression -- Industrial Paper
• Feature Extraction and Classification from Planetary Science Datasets enabled by Machine Learning