MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classification

Abstract

With the development of deep learning, supervised learning has frequently been adopted to classify remotely sensed images using convolutional networks (CNNs). However, due to the limited amount of labeled data available, supervised learning is often difficult to carry out. Therefore, we proposed an unsupervised model called multiple-layer feature-matching generative adversarial networks (MARTA GANs) to learn a representation using only unlabeled data. MARTA GANs consists of both a generative model $G$ and a discriminative model $D$. We treat $D$ as a feature extractor. To fit the complex properties of remote sensing data, we use a fusion layer to merge the mid-level and global features. $G$ can produce numerous images that are similar to the training data; therefore, $D$ can learn better representations of remotely sensed images using the training data provided by $G$. The classification results on two widely used remote sensing image databases show that the proposed method significantly improves the classification performance compared with other state-of-the-art methods.

IEEE GRSL

References in corpus (1)

• Merger-driven Fueling of Active Galactic Nuclei: Six Dual and Offset Active Galactic Nuclei Discovered with Chandra and Hubble Space Telescope Observations

Cited by in corpus (27)

• Transformers in Vision: A Survey
• Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
• A Review on Deep Learning in UAV Remote Sensing
• SiftingGAN: Generating and Sifting Labeled Samples to Improve the Remote Sensing Image Scene Classification Baseline in vitro
• Deep Learning Approach for Building Detection in Satellite Multispectral Imagery
• Vehicle Detection of Multi-source Remote Sensing Data Using Active Fine-tuning Network
• All Grains, One Scheme (AGOS): Learning Multi-grain Instance Representation for Aerial Scene Classification
• In-domain representation learning for remote sensing
• DML-GANR: Deep Metric Learning With Generative Adversarial Network Regularization for High Spatial Resolution Remote Sensing Image Retrieval
• Remote Sensing Image Scene Classification with Deep Neural Networks in JPEG 2000 Compressed Domain
• Conditional Generative Adversarial Networks for Data Augmentation and Adaptation in Remotely Sensed Imagery
• Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations: a COVID-19 case-study
• A Biologically Interpretable Two-stage Deep Neural Network (BIT-DNN) For Vegetation Recognition From Hyperspectral Imagery
• Augmenting correlation structures in spatial data using deep generative models
• Artificial Generation of Big Data for Improving Image Classification: A Generative Adversarial Network Approach on SAR Data
• Prediction of Transportation Index for Urban Patterns in Small and Medium-sized Indian Cities using Hybrid RidgeGAN Model
• Unsupervised Deep Features for Remote Sensing Image Matching via Discriminator Network
• Is Discriminator a Good Feature Extractor?
• Generating Synthetic Multispectral Satellite Imagery from Sentinel-2
• Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples
• Unsupervised Discovery of Semantic Concepts in Satellite Imagery with Style-based Wavelet-driven Generative Models
• Evaluating Self and Semi-Supervised Methods for Remote Sensing Segmentation Tasks
• Balance Scene Learning Mechanism for Offshore and Inshore Ship Detection in SAR Images
• Mixture of Spectral Generative Adversarial Networks for Imbalanced Hyperspectral Image Classification
• An End-to-End Joint Unsupervised Learning of Deep Model and Pseudo-Classes for Remote Sensing Scene Representation
• Learning to Clean: A GAN Perspective
• Calibrating Over-Parametrized Simulation Models: A Framework via Eligibility Set