A Variational Autoencoder for Probabilistic Non-Negative Matrix Factorisation

Abstract

We introduce and demonstrate the variational autoencoder (VAE) for probabilistic non-negative matrix factorisation (PAE-NMF). We design a network which can perform non-negative matrix factorisation (NMF) and add in aspects of a VAE to make the coefficients of the latent space probabilistic. By restricting the weights in the final layer of the network to be non-negative and using the non-negative Weibull distribution we produce a probabilistic form of NMF which allows us to generate new data and find a probability distribution that effectively links the latent and input variables. We demonstrate the effectiveness of PAE-NMF on three heterogeneous datasets: images, financial time series and genomic.

References in corpus (5)

• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Semi-Supervised Learning with Deep Generative Models
• Deep Learning of Part-based Representation of Data Using Sparse Autoencoders with Nonnegativity Constraints
• Computing the Kullback-Leibler Divergence between two Generalized Gamma Distributions
• Minimum description length as an objective function for non-negative matrix factorization