CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network
arXiv:2008.09388
Abstract
Generative adversarial networks (GANs) have been a popular deep generative model for real-world applications. Despite many recent efforts on GANs that have been contributed, mode collapse and instability of GANs are still open problems caused by their adversarial optimization difficulties. In this paper, motivated by the cooperative co-evolutionary algorithm, we propose a Cooperative Dual Evolution based Generative Adversarial Network (CDE-GAN) to circumvent these drawbacks. In essence, CDE-GAN incorporates dual evolution with respect to the generator(s) and discriminators into a unified evolutionary adversarial framework to conduct effective adversarial multi-objective optimization. Thus it exploits the complementary properties and injects dual mutation diversity into training to steadily diversify the estimated density in capturing multi-modes and improve generative performance. Specifically, CDE-GAN decomposes the complex adversarial optimization problem into two subproblems (generation and discrimination), and each subproblem is solved with a separated subpopulation (E-Generator} and E-Discriminators), evolved by its own evolutionary algorithm. Additionally, we further propose a Soft Mechanism to balance the trade-off between E-Generators and E-Discriminators to conduct steady training for CDE-GAN. Extensive experiments on one synthetic dataset and three real-world benchmark image datasets demonstrate that the proposed CDE-GAN achieves a competitive and superior performance in generating good quality and diverse samples over baselines. The code and more generated results are available at our project homepage: https://shiming-chen.github.io/CDE-GAN-website/CDE-GAN.html.
15 pages,6 figures,4 tables. Accepted by IEEE Transactions on Evolutionary Computation
References in corpus (14)
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Spectral Normalization for Generative Adversarial Networks
- LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
- NIPS 2016 Tutorial: Generative Adversarial Networks
- Automatically designing CNN architectures using genetic algorithm for image classification
- BEGAN: Boundary Equilibrium Generative Adversarial Networks
- Unrolled Generative Adversarial Networks
- Generalization and Equilibrium in Generative Adversarial Nets (GANs)
- A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification
- AdaGAN: Boosting Generative Models
- Stabilizing GAN Training with Multiple Random Projections
- Spatial Evolutionary Generative Adversarial Networks
- Generative Multi-Adversarial Networks
- Multi-objective training of Generative Adversarial Networks with multiple discriminators