What, Where and How to Transfer in SAR Target Recognition Based on Deep CNNs

Abstract

Deep convolutional neural networks (DCNNs) have attracted much attention in remote sensing recently. Compared with the large-scale annotated dataset in natural images, the lack of labeled data in remote sensing becomes an obstacle to train a deep network very well, especially in SAR image interpretation. Transfer learning provides an effective way to solve this problem by borrowing the knowledge from the source task to the target task. In optical remote sensing application, a prevalent mechanism is to fine-tune on an existing model pre-trained with a large-scale natural image dataset, such as ImageNet. However, this scheme does not achieve satisfactory performance for SAR application because of the prominent discrepancy between SAR and optical images. In this paper, we attempt to discuss three issues that are seldom studied before in detail: (1) what network and source tasks are better to transfer to SAR targets, (2) in which layer are transferred features more generic to SAR targets and (3) how to transfer effectively to SAR targets recognition. Based on the analysis, a transitive transfer method via multi-source data with domain adaptation is proposed in this paper to decrease the discrepancy between the source data and SAR targets. Several experiments are conducted on OpenSARShip. The results indicate that the universal conclusions about transfer learning in natural images cannot be completely applied to SAR targets, and the analysis of what and where to transfer in SAR target recognition is helpful to decide how to transfer more effectively.

References in corpus (7)

• How transferable are features in deep neural networks?
• Deep learning in remote sensing: a review
• Learning Transferable Features with Deep Adaptation Networks
• Unsupervised Domain Adaptation by Backpropagation
• Deep Domain Confusion: Maximizing for Domain Invariance
• Unsupervised Domain Adaptation with Residual Transfer Networks
• Artificial Generation of Big Data for Improving Image Classification: A Generative Adversarial Network Approach on SAR Data

Cited by in corpus (5)

• Classification of Large-Scale High-Resolution SAR Images with Deep Transfer Learning
• Physically Explainable CNN for SAR Image Classification
• Hierarchical Disentanglement-Alignment Network for Robust SAR Vehicle Recognition
• Weakly Contrastive Learning via Batch Instance Discrimination and Feature Clustering for Small Sample SAR ATR
• Deep Learning Meets SAR