VAEs in the Presence of Missing Data
arXiv:2006.05301
Abstract
Real world datasets often contain entries with missing elements e.g. in a medical dataset, a patient is unlikely to have taken all possible diagnostic tests. Variational Autoencoders (VAEs) are popular generative models often used for unsupervised learning. Despite their widespread use it is unclear how best to apply VAEs to datasets with missing data. We develop a novel latent variable model of a corruption process which generates missing data, and derive a corresponding tractable evidence lower bound (ELBO). Our model is straightforward to implement, can handle both missing completely at random (MCAR) and missing not at random (MNAR) data, scales to high dimensional inputs and gives both the VAE encoder and decoder principled access to indicator variables for whether a data element is missing or not. On the MNIST and SVHN datasets we demonstrate improved marginal log-likelihood of observed data and better missing data imputation, compared to existing approaches.
arXiv commentAccepted to ICML Workshop on the Art of Learning with Missing Values (Artemiss), 17 July 2020
References in corpus (7)
- Auto-Encoding Variational Bayes
- A guide to convolution arithmetic for deep learning
- Recent Advances in Autoencoder-Based Representation Learning
- The continuous Bernoulli: fixing a pervasive error in variational autoencoders
- Generative Models of Visually Grounded Imagination
- EDDI: Efficient Dynamic Discovery of High-Value Information with Partial VAE
- Autoencoders and Probabilistic Inference with Missing Data: An Exact Solution for The Factor Analysis Case
Cited by in corpus (6)
- Networked Time Series Imputation via Position-aware Graph Enhanced Variational Autoencoders
- not-MIWAE: Deep Generative Modelling with Missing not at Random Data
- Deep Generative Imputation Model for Missing Not At Random Data
- Astronomical Image Quality Prediction based on Environmental and Telescope Operating Conditions
- EMFlow: Data Imputation in Latent Space via EM and Deep Flow Models
- Medical data wrangling with sequential variational autoencoders