Unsupervised Deep Representation Learning and Few-Shot Classification of PolSAR Images

Abstract

Deep learning and convolutional neural networks (CNNs) have made progress in polarimetric synthetic aperture radar (PolSAR) image classification over the past few years. However, a crucial issue has not been addressed, i.e., the requirement of CNNs for abundant labeled samples versus the insufficient human annotations of PolSAR images. It is well-known that following the supervised learning paradigm may lead to the overfitting of training data, and the lack of supervision information of PolSAR images undoubtedly aggravates this problem, which greatly affects the generalization performance of CNN-based classifiers in large-scale applications. To handle this problem, in this paper, learning transferrable representations from unlabeled PolSAR data through convolutional architectures is explored for the first time. Specifically, a PolSAR-tailored contrastive learning network (PCLNet) is proposed for unsupervised deep PolSAR representation learning and few-shot classification. Different from the utilization of optical processing methods, a diversity stimulation mechanism is constructed to narrow the application gap between optics and PolSAR. Beyond the conventional supervised methods, PCLNet develops an unsupervised pre-training phase based on the proxy objective of instance discrimination to learn useful representations from unlabeled PolSAR data. The acquired representations are transferred to the downstream task, i.e., few-shot PolSAR classification. Experiments on two widely-used PolSAR benchmark datasets confirm the validity of PCLNet. Besides, this work may enlighten how to efficiently utilize the massive unlabeled PolSAR data to alleviate the greedy demands of CNN-based methods for human annotations.

arXiv comment16 pages, 16 figures

References in corpus (15)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• A Simple Framework for Contrastive Learning of Visual Representations
• Representation Learning with Contrastive Predictive Coding
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Deep learning in remote sensing: a review
• Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
• Learning deep representations by mutual information estimation and maximization
• Unsupervised Representation Learning by Predicting Image Rotations
• Momentum Contrast for Unsupervised Visual Representation Learning
• Learning Representations by Maximizing Mutual Information Across Views
• Highway Networks
• Unsupervised Learning via Meta-Learning
• Polarimetric Convolutional Network for PolSAR Image Classification
• Automatic Design of CNNs via Differentiable Neural Architecture Search for PolSAR Image Classification
• Efficiently utilizing complex-valued PolSAR image data via a multi-task deep learning framework