Cluster Alignment with a Teacher for Unsupervised Domain Adaptation

Abstract

Deep learning methods have shown promise in unsupervised domain adaptation, which aims to leverage a labeled source domain to learn a classifier for the unlabeled target domain with a different distribution. However, such methods typically learn a domain-invariant representation space to match the marginal distributions of the source and target domains, while ignoring their fine-level structures. In this paper, we propose Cluster Alignment with a Teacher (CAT) for unsupervised domain adaptation, which can effectively incorporate the discriminative clustering structures in both domains for better adaptation. Technically, CAT leverages an implicit ensembling teacher model to reliably discover the class-conditional structure in the feature space for the unlabeled target domain. Then CAT forces the features of both the source and the target domains to form discriminative class-conditional clusters and aligns the corresponding clusters across domains. Empirical results demonstrate that CAT achieves state-of-the-art results in several unsupervised domain adaptation scenarios.

arXiv commentIEEE International Conference on Computer Vision 2019

References in corpus (16)

• DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
• Learning Transferable Features with Deep Adaptation Networks
• Deep Domain Confusion: Maximizing for Domain Invariance
• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Temporal Ensembling for Semi-Supervised Learning
• Unsupervised Domain Adaptation with Residual Transfer Networks
• Asymmetric Tri-training for Unsupervised Domain Adaptation
• A DIRT-T Approach to Unsupervised Domain Adaptation
• Generative Moment Matching Networks
• On Learning Invariant Representation for Domain Adaptation
• Information-Theoretical Learning of Discriminative Clusters for Unsupervised Domain Adaptation
• Deep Transfer Learning with Joint Adaptation Networks
• Domain Adaptation with Asymmetrically-Relaxed Distribution Alignment
• Max-Mahalanobis Linear Discriminant Analysis Networks
• Image to Image Translation for Domain Adaptation
• From source to target and back: symmetric bi-directional adaptive GAN

Cited by in corpus (2)

• MixStyle Neural Networks for Domain Generalization and Adaptation
• Cross-Domain Adaptive Clustering for Semi-Supervised Domain Adaptation