Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Case

Abstract

In recent years, deep generative models have attracted increasing interest due to their capacity to model complex distributions. Among those models, variational autoencoders have gained popularity as they have proven both to be computationally efficient and yield impressive results in multiple fields. Following this breakthrough, extensive research has been done in order to improve the original publication, resulting in a variety of different VAE models in response to different tasks. In this paper we present Pythae, a versatile open-source Python library providing both a unified implementation and a dedicated framework allowing straightforward, reproducible and reliable use of generative autoencoder models. We then propose to use this library to perform a case study benchmark where we present and compare 19 generative autoencoder models representative of some of the main improvements on downstream tasks such as image reconstruction, generation, classification, clustering and interpolation. The open-source library can be found at https://github.com/clementchadebec/benchmark_VAE.

arXiv commentAccepted to NeurIPS 2022

References in corpus (16)

• Adam: A Method for Stochastic Optimization
• Scikit-learn: Machine Learning in Python
• Auto-Encoding Variational Bayes
• Neural Discrete Representation Learning
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Variational Inference with Normalizing Flows
• Disentangling by Factorising
• Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders
• Markov Chain Monte Carlo and Variational Inference: Bridging the Gap
• InfoVAE: Information Maximizing Variational Autoencoders
• Understanding disentangling in $\beta$-VAE
• Importance Weighted Autoencoders
• Data Augmentation in High Dimensional Low Sample Size Setting Using a Geometry-Based Variational Autoencoder
• From Variational to Deterministic Autoencoders
• Explorations in Homeomorphic Variational Auto-Encoding
• Metrics for Deep Generative Models