MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization

Abstract

Model-Agnostic Meta-Learning (MAML) and its variants are popular few-shot classification methods. They train an initializer across a variety of sampled learning tasks (also known as episodes) such that the initialized model can adapt quickly to new tasks. However, current MAML-based algorithms have limitations in forming generalizable decision boundaries. In this paper, we propose an approach called MetaMix. It generates virtual feature-target pairs within each episode to regularize the backbone models. MetaMix can be integrated with any of the MAML-based algorithms and learn the decision boundaries generalizing better to new tasks. Experiments on the mini-ImageNet, CUB, and FC100 datasets show that MetaMix improves the performance of MAML-based algorithms and achieves state-of-the-art result when integrated with Meta-Transfer Learning.

8 pages, 3 figures, 3 tables. Accepted by 25th International Conference on Pattern Recognition (ICPR) 2020

References in corpus (11)

• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
• Interpolation Consistency Training for Semi-Supervised Learning
• Meta-SGD: Learning to Learn Quickly for Few-Shot Learning
• MixMatch: A Holistic Approach to Semi-Supervised Learning
• On First-Order Meta-Learning Algorithms
• Meta-Learning with Latent Embedding Optimization
• Few-Shot Learning with Metric-Agnostic Conditional Embeddings
• Virtual Mixup Training for Unsupervised Domain Adaptation
• An Investigation of Few-Shot Learning in Spoken Term Classification