Semi-Supervised Learning with Deep Generative Models
arXiv:1406.5298
Abstract
The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the approach to semi-supervised learning with generative models and develop new models that allow for effective generalisation from small labelled data sets to large unlabelled ones. Generative approaches have thus far been either inflexible, inefficient or non-scalable. We show that deep generative models and approximate Bayesian inference exploiting recent advances in variational methods can be used to provide significant improvements, making generative approaches highly competitive for semi-supervised learning.
To appear in the proceedings of Neural Information Processing Systems (NIPS) 2014
Cited by in corpus (7)
- Variational Autoencoder for Deep Learning of Images, Labels and Captions
- Winner-Take-All Autoencoders
- Generalizing Skills with Semi-Supervised Reinforcement Learning
- A Probabilistic Framework for Deep Learning
- Deep Co-Space: Sample Mining Across Feature Transformation for Semi-Supervised Learning
- The Future of Data Analysis in the Neurosciences
- Coarse Grained Exponential Variational Autoencoders