Cross-Domain Few-Shot Learning by Representation Fusion
arXiv:2010.06498
Abstract
In order to quickly adapt to new data, few-shot learning aims at learning from few examples, often by using already acquired knowledge. The new data often differs from the previously seen data due to a domain shift, that is, a change of the input-target distribution. While several methods perform well on small domain shifts like new target classes with similar inputs, larger domain shifts are still challenging. Large domain shifts may result in high-level concepts that are not shared between the original and the new domain, whereas low-level concepts like edges in images might still be shared and useful. For cross-domain few-shot learning, we suggest representation fusion to unify different abstraction levels of a deep neural network into one representation. We propose Cross-domain Hebbian Ensemble Few-shot learning (CHEF), which achieves representation fusion by an ensemble of Hebbian learners acting on different layers of a deep neural network. Ablation studies show that representation fusion is a decisive factor to boost cross-domain few-shot learning. On the few-shot datasets miniImagenet and tieredImagenet with small domain shifts, CHEF is competitive with state-of-the-art methods. On cross-domain few-shot benchmark challenges with larger domain shifts, CHEF establishes novel state-of-the-art results in all categories. We further apply CHEF on a real-world cross-domain application in drug discovery. We consider a domain shift from bioactive molecules to environmental chemicals and drugs with twelve associated toxicity prediction tasks. On these tasks, that are highly relevant for computational drug discovery, CHEF significantly outperforms all its competitors. Github: https://github.com/ml-jku/chef
References in corpus (26)
- Scikit-learn: Machine Learning in Python
- Deep Learning in Neural Networks: An Overview
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Prototypical Networks for Few-shot Learning
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Improved Techniques for Training GANs
- Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
- A Simple Neural Attentive Meta-Learner
- Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
- On First-Order Meta-Learning Algorithms
- DropBlock: A regularization method for convolutional networks
- Deep Learning: A Critical Appraisal
- On Mutual Information Maximization for Representation Learning
- An introduction to domain adaptation and transfer learning
- Meta-Learning with Implicit Gradients
- Cross Attention Network for Few-shot Classification
- Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation
- Learning Robust Representations via Multi-View Information Bottleneck
- Infinite Mixture Prototypes for Few-Shot Learning
- TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning
- Hopfield Networks is All You Need
- Deep Triplet Ranking Networks for One-Shot Recognition
- Metalearning with Hebbian Fast Weights
- A Broader Study of Cross-Domain Few-Shot Learning
- On Episodes, Prototypical Networks, and Few-shot Learning
- SB-MTL: Score-based Meta Transfer-Learning for Cross-Domain Few-Shot Learning