4 citations · 10 across the 5 of their papers we have counts for
Showing 2019 · cs.LGShow all
2 papers · 2 filters
cs.LG2019
Noise Contrastive Variational Autoencoders
Octavian-Eugen Ganea, Yashas Annadani, Gary Bécigneul
We take steps towards understanding the "posterior collapse (PC)" difficulty in variational autoencoders (VAEs),~i.e. a degenerate optimum in which the latent codes become independ…
cs.LG2019★ 4 cited
Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities
Octavian-Eugen Ganea, Sylvain Gelly, Gary Bécigneul +1
The Softmax function on top of a final linear layer is the de facto method to output probability distributions in neural networks. In many applications such as language models or t…