Multi-Facet Clustering Variational Autoencoders
arXiv:2106.05241
Abstract
Work in deep clustering focuses on finding a single partition of data. However, high-dimensional data, such as images, typically feature multiple interesting characteristics one could cluster over. For example, images of objects against a background could be clustered over the shape of the object and separately by the colour of the background. In this paper, we introduce Multi-Facet Clustering Variational Autoencoders (MFCVAE), a novel class of variational autoencoders with a hierarchy of latent variables, each with a Mixture-of-Gaussians prior, that learns multiple clusterings simultaneously, and is trained fully unsupervised and end-to-end. MFCVAE uses a progressively-trained ladder architecture which leads to highly stable performance. We provide novel theoretical results for optimising the ELBO analytically with respect to the categorical variational posterior distribution, correcting earlier influential theoretical work. On image benchmarks, we demonstrate that our approach separates out and clusters over different aspects of the data in a disentangled manner. We also show other advantages of our model: the compositionality of its latent space and that it provides controlled generation of samples.
arXiv commentAdvances in Neural Information Processing Systems 34 (NeurIPS 2021)
References in corpus (12)
- Scikit-learn: Machine Learning in Python
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Auto-Encoding Variational Bayes
- Categorical Reparameterization with Gumbel-Softmax
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
- Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations
- Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering
- Learning Discrete Representations via Information Maximizing Self-Augmented Training
- Clustering with Deep Learning: Taxonomy and New Methods
- Learning Latent Superstructures in Variational Autoencoders for Deep Multidimensional Clustering
- Progressive Learning and Disentanglement of Hierarchical Representations
- Disentangling to Cluster: Gaussian Mixture Variational Ladder Autoencoders