MetaFun: Meta-Learning with Iterative Functional Updates
arXiv:1912.02738
Abstract
We develop a functional encoder-decoder approach to supervised meta-learning, where labeled data is encoded into an infinite-dimensional functional representation rather than a finite-dimensional one. Furthermore, rather than directly producing the representation, we learn a neural update rule resembling functional gradient descent which iteratively improves the representation. The final representation is used to condition the decoder to make predictions on unlabeled data. Our approach is the first to demonstrates the success of encoder-decoder style meta-learning methods like conditional neural processes on large-scale few-shot classification benchmarks such as miniImageNet and tieredImageNet, where it achieves state-of-the-art performance.
References in corpus (8)
- Prototypical Networks for Few-shot Learning
- A Simple Neural Attentive Meta-Learner
- Meta-SGD: Learning to Learn Quickly for Few-Shot Learning
- Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
- On First-Order Meta-Learning Algorithms
- Janossy Pooling: Learning Deep Permutation-Invariant Functions for Variable-Size Inputs
- Probabilistic symmetries and invariant neural networks
- Discriminative k-shot learning using probabilistic models