Dual Contradistinctive Generative Autoencoder

Abstract

We present a new generative autoencoder model with dual contradistinctive losses to improve generative autoencoder that performs simultaneous inference (reconstruction) and synthesis (sampling). Our model, named dual contradistinctive generative autoencoder (DC-VAE), integrates an instance-level discriminative loss (maintaining the instance-level fidelity for the reconstruction/synthesis) with a set-level adversarial loss (encouraging the set-level fidelity for there construction/synthesis), both being contradistinctive. Extensive experimental results by DC-VAE across different resolutions including 32x32, 64x64, 128x128, and 512x512 are reported. The two contradistinctive losses in VAE work harmoniously in DC-VAE leading to a significant qualitative and quantitative performance enhancement over the baseline VAEs without architectural changes. State-of-the-art or competitive results among generative autoencoders for image reconstruction, image synthesis, image interpolation, and representation learning are observed. DC-VAE is a general-purpose VAE model, applicable to a wide variety of downstream tasks in computer vision and machine learning.

References in corpus (12)

• Auto-Encoding Variational Bayes
• A Simple Framework for Contrastive Learning of Visual Representations
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
• The relativistic discriminator: a key element missing from standard GAN
• A Theory of Generative ConvNet
• IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis
• On Variational Bounds of Mutual Information
• Prescribed Generative Adversarial Networks
• Improving MMD-GAN Training with Repulsive Loss Function
• Introspective Classification with Convolutional Nets