Land Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks

Abstract

Nowadays, modern earth observation programs produce huge volumes of satellite images time series (SITS) that can be useful to monitor geographical areas through time. How to efficiently analyze such kind of information is still an open question in the remote sensing field. Recently, deep learning methods proved suitable to deal with remote sensing data mainly for scene classification (i.e. Convolutional Neural Networks - CNNs - on single images) while only very few studies exist involving temporal deep learning approaches (i.e Recurrent Neural Networks - RNNs) to deal with remote sensing time series. In this letter we evaluate the ability of Recurrent Neural Networks, in particular the Long-Short Term Memory (LSTM) model, to perform land cover classification considering multi-temporal spatial data derived from a time series of satellite images. We carried out experiments on two different datasets considering both pixel-based and object-based classification. The obtained results show that Recurrent Neural Networks are competitive compared to state-of-the-art classifiers, and may outperform classical approaches in presence of low represented and/or highly mixed classes. We also show that using the alternative feature representation generated by LSTM can improve the performances of standard classifiers.

References in corpus (2)

• Conditional Image Generation with PixelCNN Decoders
• Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies

Cited by in corpus (14)

• Deep learning in agriculture: A survey
• A Review on Deep Learning in UAV Remote Sensing
• Target-adaptive CNN-based pansharpening
• Current Trends in Deep Learning for Earth Observation: An Open-source Benchmark Arena for Image Classification
• Deep Learning for Satellite Image Time Series Analysis: A Review
• TimeMatch: Unsupervised Cross-Region Adaptation by Temporal Shift Estimation
• A framework for remote sensing images processing using deep learning technique
• A comparative study of different machine learning methods for dissipative quantum dynamics
• Context-self contrastive pretraining for crop type semantic segmentation
• Attentive Weakly Supervised land cover mapping for object-based satellite image time series data with spatial interpretation
• Semi-supervised Learning with Graphs: Covariance Based Superpixels For Hyperspectral Image Classification
• MRFusion: A Deep Learning architecture to fuse PAN and MS imagery for land cover mapping
• Supervised level-wise pretraining for recurrent neural network initialization in multi-class classification
• Channel-Based Attention for LCC Using Sentinel-2 Time Series