Multi-source Few-shot Domain Adaptation

Abstract

Multi-source Domain Adaptation (MDA) aims to transfer predictive models from multiple, fully-labeled source domains to an unlabeled target domain. However, in many applications, relevant labeled source datasets may not be available, and collecting source labels can be as expensive as labeling the target data itself. In this paper, we investigate Multi-source Few-shot Domain Adaptation (MFDA): a new domain adaptation scenario with limited multi-source labels and unlabeled target data. As we show, existing methods often fail to learn discriminative features for both source and target domains in the MFDA setting. Therefore, we propose a novel framework, termed Multi-Source Few-shot Adaptation Network (MSFAN), which can be trained end-to-end in a non-adversarial manner. MSFAN operates by first using a type of prototypical, multi-domain, self-supervised learning to learn features that are not only domain-invariant but also class-discriminative. Second, MSFAN uses a small, labeled support set to enforce feature consistency and domain invariance across domains. Finally, prototypes from multiple sources are leveraged to learn better classifiers. Compared with state-of-the-art MDA methods, MSFAN improves the mean classification accuracy over different domain pairs on MFDA by 20.2%, 9.4%, and 16.2% on Office, Office-Home, and DomainNet, respectively.

References in corpus (21)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• A Simple Framework for Contrastive Learning of Visual Representations
• DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
• Bootstrap your own latent: A new approach to self-supervised Learning
• Learning Transferable Features with Deep Adaptation Networks
• Deep Domain Confusion: Maximizing for Domain Invariance
• Improved Baselines with Momentum Contrastive Learning
• Conditional Adversarial Domain Adaptation
• Unsupervised Domain Adaptation with Residual Transfer Networks
• Prototypical Contrastive Learning of Unsupervised Representations
• Big Self-Supervised Models are Strong Semi-Supervised Learners
• Aligning Domain-specific Distribution and Classifier for Cross-domain Classification from Multiple Sources
• Wasserstein Distance Guided Representation Learning for Domain Adaptation
• A Closer Look at Few-shot Classification
• Unsupervised Domain Adaptation through Self-Supervision
• Multi-source Domain Adaptation for Semantic Segmentation
• Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation
• Cross-domain Self-supervised Learning for Domain Adaptation with Few Source Labels
• Self-Supervised Learning for Domain Adaptation on Point-Clouds
• Multi-Domain Adversarial Learning
• Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptation