Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art

Abstract

Since their inception in 2014, Generative Adversarial Networks (GANs) have rapidly emerged as powerful tools for generating realistic and diverse data across various domains, including computer vision and other applied areas. Consisting of a discriminative network and a generative network engaged in a Minimax game, GANs have revolutionized the field of generative modeling. In February 2018, GAN secured the leading spot on the ``Top Ten Global Breakthrough Technologies List'' issued by the Massachusetts Science and Technology Review. Over the years, numerous advancements have been proposed, leading to a rich array of GAN variants, such as conditional GAN, Wasserstein GAN, CycleGAN, and StyleGAN, among many others. This survey aims to provide a general overview of GANs, summarizing the latent architecture, validation metrics, and application areas of the most widely recognized variants. We also delve into recent theoretical developments, exploring the profound connection between the adversarial principle underlying GAN and Jensen-Shannon divergence, while discussing the optimality characteristics of the GAN framework. The efficiency of GAN variants and their model architectures will be evaluated along with training obstacles as well as training solutions. In addition, a detailed discussion will be provided, examining the integration of GANs with newly developed deep learning frameworks such as Transformers, Physics-Informed Neural Networks, Large Language models, and Diffusion models. Finally, we reveal several issues as well as future research outlines in this field.

References in corpus (34)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Conditional Generative Adversarial Nets
• Explaining and Harnessing Adversarial Examples
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• WaveNet: A Generative Model for Raw Audio
• Towards A Rigorous Science of Interpretable Machine Learning
• Hierarchical Text-Conditional Image Generation with CLIP Latents
• Diffusion Models Beat GANs on Image Synthesis
• Diffusion Models in Vision: A Survey
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Zero-Shot Text-to-Image Generation
• Do ImageNet Classifiers Generalize to ImageNet?
• Do GANs actually learn the distribution? An empirical study
• Experimental quantum adversarial learning with programmable superconducting qubits
• A very preliminary analysis of DALL-E 2
• Conditional GAN for timeseries generation
• TensorLayer: A Versatile Library for Efficient Deep Learning Development
• Approximation and Convergence Properties of Generative Adversarial Learning
• W-Transformers : A Wavelet-based Transformer Framework for Univariate Time Series Forecasting
• Knowledge-based Deep Learning for Modeling Chaotic Systems
• PID-GAN: A GAN Framework based on a Physics-informed Discriminator for Uncertainty Quantification with Physics
• Epicasting: An Ensemble Wavelet Neural Network (EWNet) for Forecasting Epidemics
• A Survey on Uncertainty Quantification Methods for Deep Learning
• MetroGAN: Simulating Urban Morphology with Generative Adversarial Network
• Towards Imperceptible and Robust Adversarial Example Attacks against Neural Networks
• Review of end-to-end speech synthesis technology based on deep learning
• Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generation
• Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias
• Prediction of Transportation Index for Urban Patterns in Small and Medium-sized Indian Cities using Hybrid RidgeGAN Model
• Spatial sensitivity analysis for urban land use prediction with physics-constrained conditional generative adversarial networks
• DEQGAN: Learning the Loss Function for PINNs with Generative Adversarial Networks
• On the Privacy Properties of GAN-generated Samples
• PAC-Bayesian Generalization Bounds for Adversarial Generative Models
• Measure-conditional Discriminator with Stationary Optimum for GANs and Statistical Distance Surrogates

Cited by in corpus (2)

• When Geoscience Meets Generative AI and Large Language Models: Foundations, Trends, and Future Challenges
• Skew-Probabilistic Neural Networks for Learning from Imbalanced Data