Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning
arXiv:2306.10511 · doi:10.1109/TPAMI.2023.3272697
Abstract
Few-shot learning aims to recognize novel queries with limited support samples by learning from base knowledge. Recent progress in this setting assumes that the base knowledge and novel query samples are distributed in the same domains, which are usually infeasible for realistic applications. Toward this issue, we propose to address the cross-domain few-shot learning problem where only extremely few samples are available in target domains. Under this realistic setting, we focus on the fast adaptation capability of meta-learners by proposing an effective dual adaptive representation alignment approach. In our approach, a prototypical feature alignment is first proposed to recalibrate support instances as prototypes and reproject these prototypes with a differentiable closed-form solution. Therefore feature spaces of learned knowledge can be adaptively transformed to query spaces by the cross-instance and cross-prototype relations. Besides the feature alignment, we further present a normalized distribution alignment module, which exploits prior statistics of query samples for solving the covariant shifts among the support and query samples. With these two modules, a progressive meta-learning framework is constructed to perform the fast adaptation with extremely few-shot samples while maintaining its generalization capabilities. Experimental evidence demonstrates our approach achieves new state-of-the-art results on 4 CDFSL benchmarks and 4 fine-grained cross-domain benchmarks.
arXiv comment13 pages; Accepted by IEEE T-PAMI
References in corpus (15)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Prototypical Networks for Few-shot Learning
- The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions
- ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Fully Convolutional Networks for Semantic Segmentation
- Deep Domain Confusion: Maximizing for Domain Invariance
- Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
- Meta-SGD: Learning to Learn Quickly for Few-Shot Learning
- Meta-Learning for Semi-Supervised Few-Shot Classification
- Revisiting Batch Normalization For Practical Domain Adaptation
- Batch-Instance Normalization for Adaptively Style-Invariant Neural Networks
- Feature Transformation Ensemble Model with Batch Spectral Regularization for Cross-Domain Few-Shot Classification