Learning to generate classifiers
arXiv:1803.11373
Abstract
We train a network to generate mappings between training sets and classification policies (a 'classifier generator') by conditioning on the entire training set via an attentional mechanism. The network is directly optimized for test set performance on an training set of related tasks, which is then transferred to unseen 'test' tasks. We use this to optimize for performance in the low-data and unsupervised learning regimes, and obtain significantly better performance in the 10-50 datapoint regime than support vector classifiers, random forests, XGBoost, and k-nearest neighbors on a range of small datasets.
arXiv comment11 pages, 3 figures
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Matching Networks for One Shot Learning
- A Simple Neural Attentive Meta-Learner
- Meta-Learning for Semi-Supervised Few-Shot Classification
- PathNet: Evolution Channels Gradient Descent in Super Neural Networks
- One-shot Learning with Memory-Augmented Neural Networks
- Order Matters: Sequence to sequence for sets
- Towards a Neural Statistician
- Neural Map: Structured Memory for Deep Reinforcement Learning