25 citations · 28 across the 7 of their papers we have counts for
3 papers · 1 filter
Generative Models with ELBOs Converging to Entropy Sums
Jan Warnken, Dmytro Velychko, Simon Damm +2
The evidence lower bound (ELBO) is one of the most central objectives for probabilistic unsupervised learning. For the ELBOs of several generative models and model classes, we here…
Learning Sparse Codes with Entropy-Based ELBOs
Dmytro Velychko, Simon Damm, Asja Fischer +1
Standard probabilistic sparse coding assumes a Laplace prior, a linear mapping from latents to observables, and Gaussian observable distributions. We here derive a solely entropy-b…
The ELBO of Variational Autoencoders Converges to a Sum of Three Entropies
Simon Damm, Dennis Forster, Dmytro Velychko +3
The central objective function of a variational autoencoder (VAE) is its variational lower bound (the ELBO). Here we show that for standard (i.e., Gaussian) VAEs the ELBO converges…