Cross-domain Self-supervised Learning for Domain Adaptation with Few Source Labels

Abstract

Existing unsupervised domain adaptation methods aim to transfer knowledge from a label-rich source domain to an unlabeled target domain. However, obtaining labels for some source domains may be very expensive, making complete labeling as used in prior work impractical. In this work, we investigate a new domain adaptation scenario with sparsely labeled source data, where only a few examples in the source domain have been labeled, while the target domain is unlabeled. We show that when labeled source examples are limited, existing methods often fail to learn discriminative features applicable for both source and target domains. We propose a novel Cross-Domain Self-supervised (CDS) learning approach for domain adaptation, which learns features that are not only domain-invariant but also class-discriminative. Our self-supervised learning method captures apparent visual similarity with in-domain self-supervision in a domain adaptive manner and performs cross-domain feature matching with across-domain self-supervision. In extensive experiments with three standard benchmark datasets, our method significantly boosts performance of target accuracy in the new target domain with few source labels and is even helpful on classical domain adaptation scenarios.

References in corpus (13)

• Distilling the Knowledge in a Neural Network
• Deep Domain Confusion: Maximizing for Domain Invariance
• Conditional Adversarial Domain Adaptation
• Unsupervised Domain Adaptation with Residual Transfer Networks
• Momentum Contrast for Unsupervised Visual Representation Learning
• VisDA: The Visual Domain Adaptation Challenge
• DeepJDOT: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptation
• Wasserstein Distance Guided Representation Learning for Domain Adaptation
• Bridging Theory and Algorithm for Domain Adaptation
• Unsupervised Domain Adaptation through Self-Supervision
• Self-supervised Domain Adaptation for Computer Vision Tasks
• Universal Domain Adaptation through Self Supervision
• Domain-Adversarial Training of Neural Networks

Cited by in corpus (8)

• A Review of Single-Source Deep Unsupervised Visual Domain Adaptation
• Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptation
• CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation
• Learning Invariant Representations and Risks for Semi-supervised Domain Adaptation
• Gradient Regularized Contrastive Learning for Continual Domain Adaptation
• Prototypical Cross-domain Knowledge Transfer for Cervical Dysplasia Visual Inspection
• Multi-source Few-shot Domain Adaptation
• Towards Unsupervised Sketch-based Image Retrieval