Multi-Representation Adaptation Network for Cross-domain Image Classification

Abstract

In image classification, it is often expensive and time-consuming to acquire sufficient labels. To solve this problem, domain adaptation often provides an attractive option given a large amount of labeled data from a similar nature but different domain. Existing approaches mainly align the distributions of representations extracted by a single structure and the representations may only contain partial information, e.g., only contain part of the saturation, brightness, and hue information. Along this line, we propose Multi-Representation Adaptation which can dramatically improve the classification accuracy for cross-domain image classification and specially aims to align the distributions of multiple representations extracted by a hybrid structure named Inception Adaptation Module (IAM). Based on this, we present Multi-Representation Adaptation Network (MRAN) to accomplish the cross-domain image classification task via multi-representation alignment which can capture the information from different aspects. In addition, we extend Maximum Mean Discrepancy (MMD) to compute the adaptation loss. Our approach can be easily implemented by extending most feed-forward models with IAM, and the network can be trained efficiently via back-propagation. Experiments conducted on three benchmark image datasets demonstrate the effectiveness of MRAN. The code has been available at https://github.com/easezyc/deep-transfer-learning.

Neural Networks regular paper. Transfer Learning, Domain Adaptation

References in corpus (8)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Learning Transferable Features with Deep Adaptation Networks
• Unsupervised Domain Adaptation by Backpropagation
• Deep Domain Confusion: Maximizing for Domain Invariance
• Adversarial Discriminative Domain Adaptation
• Aligning Domain-specific Distribution and Classifier for Cross-domain Classification from Multiple Sources
• Deep CORAL: Correlation Alignment for Deep Domain Adaptation
• Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation

Cited by in corpus (4)

• Deep Subdomain Adaptation Network for Image Classification
• Modeling Users' Behavior Sequences with Hierarchical Explainable Network for Cross-domain Fraud Detection
• Transfer Learning Toolkit: Primers and Benchmarks
• DRR4Covid: Learning Automated COVID-19 Infection Segmentation from Digitally Reconstructed Radiographs