Class-Distinct and Class-Mutual Image Generation with GANs
arXiv:1811.11163
Abstract
Class-conditional extensions of generative adversarial networks (GANs), such as auxiliary classifier GAN (AC-GAN) and conditional GAN (cGAN), have garnered attention owing to their ability to decompose representations into class labels and other factors and to boost the training stability. However, a limitation is that they assume that each class is separable and ignore the relationship between classes even though class overlapping frequently occurs in a real-world scenario when data are collected on the basis of diverse or ambiguous criteria. To overcome this limitation, we address a novel problem called class-distinct and class-mutual image generation, in which the goal is to construct a generator that can capture between-class relationships and generate an image selectively conditioned on the class specificity. To solve this problem without additional supervision, we propose classifier's posterior GAN (CP-GAN), in which we redesign the generator input and the objective function of AC-GAN for class-overlapping data. Precisely, we incorporate the classifier's posterior into the generator input and optimize the generator so that the classifier's posterior of generated data corresponds with that of real data. We demonstrate the effectiveness of CP-GAN using both controlled and real-world class-overlapping data with a model configuration analysis and comparative study. Our code is available at https://github.com/takuhirok/CP-GAN/.
arXiv commentAccepted to BMVC 2019 (Spotlight). Project page: https://takuhirok.github.io/CP-GAN/
References in corpus (27)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Auto-Encoding Variational Bayes
- Conditional Generative Adversarial Nets
- WaveNet: A Generative Model for Raw Audio
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Spectral Normalization for Generative Adversarial Networks
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Self-Attention Generative Adversarial Networks
- Empirical Evaluation of Rectified Activations in Convolutional Network
- Generative Adversarial Text to Image Synthesis
- Conditional Image Synthesis With Auxiliary Classifier GANs
- Conditional Image Generation with PixelCNN Decoders
- Pixel Recurrent Neural Networks
- Semi-Supervised Learning with Deep Generative Models
- InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
- Energy-based Generative Adversarial Network
- Which Training Methods for GANs do actually Converge?
- A Learned Representation For Artistic Style
- Deep Convolutional Inverse Graphics Network
- Invertible Conditional GANs for image editing
- A Closer Look at Memorization in Deep Networks
- Adversarial Autoencoders
- Modulating early visual processing by language
- Deep Identity-aware Transfer of Facial Attributes
- Age Progression/Regression by Conditional Adversarial Autoencoder
- Hierarchical Implicit Models and Likelihood-Free Variational Inference
- Generative Adversarial Image Synthesis with Decision Tree Latent Controller