Learning Latent Subspaces in Variational Autoencoders

Abstract

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of unsupervised learning of features correlated to specific labels in a dataset. We propose a VAE-based generative model which we show is capable of extracting features correlated to binary labels in the data and structuring it in a latent subspace which is easy to interpret. Our model, the Conditional Subspace VAE (CSVAE), uses mutual information minimization to learn a low-dimensional latent subspace associated with each label that can easily be inspected and independently manipulated. We demonstrate the utility of the learned representations for attribute manipulation tasks on both the Toronto Face and CelebA datasets.

Published as a conference paper at NeurIPS 2018. 15 pages

Cited by in corpus (7)

• Study of Deep Generative Models for Inorganic Chemical Compositions
• MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network
• An Improved Semi-Supervised VAE for Learning Disentangled Representations
• DualDis: Dual-Branch Disentangling with Adversarial Learning
• Adversarial Disentanglement with Grouped Observations
• TzK: Flow-Based Conditional Generative Model
• High Mutual Information in Representation Learning with Symmetric Variational Inference