A Deep Generative Deconvolutional Image Model
arXiv:1512.07344
Abstract
A deep generative model is developed for representation and analysis of images, based on a hierarchical convolutional dictionary-learning framework. Stochastic {\em unpooling} is employed to link consecutive layers in the model, yielding top-down image generation. A Bayesian support vector machine is linked to the top-layer features, yielding max-margin discrimination. Deep deconvolutional inference is employed when testing, to infer the latent features, and the top-layer features are connected with the max-margin classifier for discrimination tasks. The model is efficiently trained using a Monte Carlo expectation-maximization (MCEM) algorithm, with implementation on graphical processor units (GPUs) for efficient large-scale learning, and fast testing. Excellent results are obtained on several benchmark datasets, including ImageNet, demonstrating that the proposed model achieves results that are highly competitive with similarly sized convolutional neural networks.
arXiv comment10 pages, 7 figures. Appearing in Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS) 2016, Cadiz, Spain. JMLR: W&CP volume 41
References in corpus (8)
- Playing Atari with Deep Reinforcement Learning
- DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
- Spike and slab variable selection: Frequentist and Bayesian strategies
- Supervised Dictionary Learning
- Stochastic Pooling for Regularization of Deep Convolutional Neural Networks
- Some Improvements on Deep Convolutional Neural Network Based Image Classification
- Equilibrated adaptive learning rates for non-convex optimization
- Max-margin Deep Generative Models