Assume, Augment and Learn: Unsupervised Few-Shot Meta-Learning via Random Labels and Data Augmentation

Abstract

The field of few-shot learning has been laboriously explored in the supervised setting, where per-class labels are available. On the other hand, the unsupervised few-shot learning setting, where no labels of any kind are required, has seen little investigation. We propose a method, named Assume, Augment and Learn or AAL, for generating few-shot tasks using unlabeled data. We randomly label a random subset of images from an unlabeled dataset to generate a support set. Then by applying data augmentation on the support set's images, and reusing the support set's labels, we obtain a target set. The resulting few-shot tasks can be used to train any standard meta-learning framework. Once trained, such a model, can be directly applied on small real-labeled datasets without any changes or fine-tuning required. In our experiments, the learned models achieve good generalization performance in a variety of established few-shot learning tasks on Omniglot and Mini-Imagenet.

arXiv commentWork in Progress - Under Review in ICML 2019

References in corpus (10)

• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• WaveNet: A Generative Model for Raw Audio
• Improved Regularization of Convolutional Neural Networks with Cutout
• Tutorial on Variational Autoencoders
• AutoAugment: Learning Augmentation Policies from Data
• Deep Clustering for Unsupervised Learning of Visual Features
• One-shot Learning with Memory-Augmented Neural Networks
• Unsupervised Learning via Meta-Learning
• How to train your MAML

Cited by in corpus (17)

• Free Lunch for Few-shot Learning: Distribution Calibration
• Unsupervised Meta-Learning for Reinforcement Learning
• Meta-Learning Requires Meta-Augmentation
• Data Augmentation for Meta-Learning
• Diversity Helps: Unsupervised Few-shot Learning via Distribution Shift-based Data Augmentation
• Towards Cross-Granularity Few-Shot Learning: Coarse-to-Fine Pseudo-Labeling with Visual-Semantic Meta-Embedding
• Unsupervised Few-shot Learning via Self-supervised Training
• ProtoTransformer: A Meta-Learning Approach to Providing Student Feedback
• Contrastive Prototype Learning with Augmented Embeddings for Few-Shot Learning
• SketchEmbedNet: Learning Novel Concepts by Imitating Drawings
• Unsupervised Meta-Learning through Latent-Space Interpolation in Generative Models
• What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Data
• Are Fewer Labels Possible for Few-shot Learning?
• Few Shot Learning With No Labels
• Empirical Perspectives on One-Shot Semi-supervised Learning
• Trainable Class Prototypes for Few-Shot Learning
• Online Unsupervised Learning of Visual Representations and Categories