Multi-Representation Adaptation Network for Cross-domain Image Classification

Abstract

In image classification, it is often expensive and time-consuming to acquire sufficient labels. To solve this problem, domain adaptation often provides an attractive option given a large amount of labeled data from a similar nature but different domain. Existing approaches mainly align the distributions of representations extracted by a single structure and the representations may only contain partial information, e.g., only contain part of the saturation, brightness, and hue information. Along this line, we propose Multi-Representation Adaptation which can dramatically improve the classification accuracy for cross-domain image classification and specially aims to align the distributions of multiple representations extracted by a hybrid structure named Inception Adaptation Module (IAM). Based on this, we present Multi-Representation Adaptation Network (MRAN) to accomplish the cross-domain image classification task via multi-representation alignment which can capture the information from different aspects. In addition, we extend Maximum Mean Discrepancy (MMD) to compute the adaptation loss. Our approach can be easily implemented by extending most feed-forward models with IAM, and the network can be trained efficiently via back-propagation. Experiments conducted on three benchmark image datasets demonstrate the effectiveness of MRAN. The code has been available at https://github.com/easezyc/deep-transfer-learning.

arXiv commentNeural Networks regular paper. Transfer Learning, Domain Adaptation

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
• Learning Transferable Features with Deep Adaptation Networks
• Unsupervised Domain Adaptation by Backpropagation
• Deep Domain Confusion: Maximizing for Domain Invariance
• Adversarial Discriminative Domain Adaptation
• Aligning Domain-specific Distribution and Classifier for Cross-domain Classification from Multiple Sources
• Deep CORAL: Correlation Alignment for Deep Domain Adaptation
• Multi-Adversarial Domain Adaptation
• Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation
• Deep Adversarial Attention Alignment for Unsupervised Domain Adaptation: the Benefit of Target Expectation Maximization

Cited by in corpus (14)

• Deep Subdomain Adaptation Network for Image Classification
• Single-source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification
• A Comprehensive Survey on Transfer Learning
• Transfer Learning with Dynamic Distribution Adaptation
• Language-aware Domain Generalization Network for Cross-Scene Hyperspectral Image Classification
• Memory-Guided Multi-View Multi-Domain Fake News Detection
• Modeling Users' Behavior Sequences with Hierarchical Explainable Network for Cross-domain Fraud Detection
• Transfer Learning with Dynamic Adversarial Adaptation Network
• Multi-source Domain Adaptation for Text-independent Forensic Speaker Recognition
• Domain-knowledge Inspired Pseudo Supervision (DIPS) for Unsupervised Image-to-Image Translation Models to Support Cross-Domain Classification
• Stacking Ensemble Learning in Deep Domain Adaptation for Ophthalmic Image Classification
• Transfer Learning Toolkit: Primers and Benchmarks
• DRR4Covid: Learning Automated COVID-19 Infection Segmentation from Digitally Reconstructed Radiographs
• Selective Information Passing for MR/CT Image Segmentation