Domain-Adaptive Few-Shot Learning

Abstract

Existing few-shot learning (FSL) methods make the implicit assumption that the few target class samples are from the same domain as the source class samples. However, in practice this assumption is often invalid -- the target classes could come from a different domain. This poses an additional challenge of domain adaptation (DA) with few training samples. In this paper, the problem of domain-adaptive few-shot learning (DA-FSL) is tackled, which requires solving FSL and DA in a unified framework. To this end, we propose a novel domain-adversarial prototypical network (DAPN) model. It is designed to address a specific challenge in DA-FSL: the DA objective means that the source and target data distributions need to be aligned, typically through a shared domain-adaptive feature embedding space; but the FSL objective dictates that the target domain per class distribution must be different from that of any source domain class, meaning aligning the distributions across domains may harm the FSL performance. How to achieve global domain distribution alignment whilst maintaining source/target per-class discriminativeness thus becomes the key. Our solution is to explicitly enhance the source/target per-class separation before domain-adaptive feature embedding learning in the DAPN, in order to alleviate the negative effect of domain alignment on FSL. Extensive experiments show that our DAPN outperforms the state-of-the-art FSL and DA models, as well as their naïve combinations. The code is available at https://github.com/dingmyu/DAPN.

References in corpus (12)

• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Learning Transferable Features with Deep Adaptation Networks
• Deep Domain Confusion: Maximizing for Domain Invariance
• Conditional Adversarial Domain Adaptation
• Unsupervised Domain Adaptation with Residual Transfer Networks
• Domain Separation Networks
• Beyond Sharing Weights for Deep Domain Adaptation
• One-shot Learning with Memory-Augmented Neural Networks
• Multi-style Generative Network for Real-time Transfer
• Moment Matching for Multi-Source Domain Adaptation
• Larger Norm More Transferable: An Adaptive Feature Norm Approach for Unsupervised Domain Adaptation

Cited by in corpus (3)

• Repurposing Pretrained Models for Robust Out-of-domain Few-Shot Learning
• Revisiting Mid-Level Patterns for Cross-Domain Few-Shot Recognition
• TOHAN: A One-step Approach towards Few-shot Hypothesis Adaptation