A Novel Framework for Selection of GANs for an Application
arXiv:2002.08641
Abstract
Generative Adversarial Network (GAN) is a current focal point of research. The body of knowledge is fragmented, leading to a trial-error method while selecting an appropriate GAN for a given scenario. We provide a comprehensive summary of the evolution of GANs starting from its inception addressing issues like mode collapse, vanishing gradient, unstable training and non-convergence. We also provide a comparison of various GANs from the application point of view, its behaviour and implementation details. We propose a novel framework to identify candidate GANs for a specific use case based on architecture, loss, regularization and divergence. We also discuss application of the framework using an example, and we demonstrate a significant reduction in search space. This efficient way to determine potential GANs lowers unit economics of AI development for organizations.
arXiv comment11 pages, 1 figure, 8 tables
References in corpus (46)
- Adam: A Method for Stochastic Optimization
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Spectral Normalization for Generative Adversarial Networks
- Self-Attention Generative Adversarial Networks
- Conditional Image Synthesis With Auxiliary Classifier GANs
- Progressive Growing of GANs for Improved Quality, Stability, and Variation
- Improved Training of Wasserstein GANs
- Improved Techniques for Training GANs
- LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
- NIPS 2016 Tutorial: Generative Adversarial Networks
- Energy-based Generative Adversarial Network
- Which Training Methods for GANs do actually Converge?
- BEGAN: Boundary Equilibrium Generative Adversarial Networks
- Estimating divergence functionals and the likelihood ratio by convex risk minimization
- Autoencoding beyond pixels using a learned similarity metric
- f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
- The relativistic discriminator: a key element missing from standard GAN
- Layer Normalization
- Unrolled Generative Adversarial Networks
- MaskGAN: Better Text Generation via Filling in the______
- Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
- Real-valued (Medical) Time Series Generation with Recurrent Conditional GANs
- A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
- Spectral Norm Regularization for Improving the Generalizability of Deep Learning
- Learning in Implicit Generative Models
- Adversarial Video Generation on Complex Datasets
- MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks
- EEG-GAN: Generative adversarial networks for electroencephalograhic (EEG) brain signals
- Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step
- Adversarial Generation of Natural Language
- Hierarchical Implicit Models and Likelihood-Free Variational Inference
- On integral probability metrics, ϕ-divergences and binary classification
- On distinguishability criteria for estimating generative models
- Improving Generalization and Stability of Generative Adversarial Networks
- Stabilizing Generative Adversarial Networks: A Survey
- Geometric GAN
- Generative adversarial network-based glottal waveform model for statistical parametric speech synthesis
- Towards High Resolution Video Generation with Progressive Growing of Sliced Wasserstein GANs
- A Probe Towards Understanding GAN and VAE Models
- Towards a Better Understanding and Regularization of GAN Training Dynamics
- Progressive Augmentation of GANs
- The Six Fronts of the Generative Adversarial Networks
- Generative Adversarial Networks (GANs): What it can generate and What it cannot?
- On the Implicit Assumptions of GANs