Generative Adversarial Networks (GANs): An Overview of Theoretical Model, Evaluation Metrics, and Recent Developments

Abstract

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial Network (GAN) is an effective method to address this problem. The GANs provide an appropriate way to learn deep representations without widespread use of labeled training data. This approach has attracted the attention of many researchers in computer vision since it can generate a large amount of data without precise modeling of the probability density function (PDF). In GANs, the generative model is estimated via a competitive process where the generator and discriminator networks are trained simultaneously. The generator learns to generate plausible data, and the discriminator learns to distinguish fake data created by the generator from real data samples. Given the rapid growth of GANs over the last few years and their application in various fields, it is necessary to investigate these networks accurately. In this paper, after introducing the main concepts and the theory of GAN, two new deep generative models are compared, the evaluation metrics utilized in the literature and challenges of GANs are also explained. Moreover, the most remarkable GAN architectures are categorized and discussed. Finally, the essential applications in computer vision are examined.

arXiv commentSubmitted to a journal in the computer vision field

References in corpus (14)

• Auto-Encoding Variational Bayes
• Conditional Generative Adversarial Nets
• Generative Adversarial Networks: An Overview
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• Self-Attention Generative Adversarial Networks
• Conditional Image Synthesis With Auxiliary Classifier GANs
• NIPS 2016 Tutorial: Generative Adversarial Networks
• ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
• Energy-based Generative Adversarial Network
• The relativistic discriminator: a key element missing from standard GAN
• Semi-Supervised Learning with Generative Adversarial Networks
• Unrolled Generative Adversarial Networks
• How Generative Adversarial Networks and Their Variants Work: An Overview

Cited by in corpus (4)

• A survey of synthetic data augmentation methods in computer vision
• A review of Generative Adversarial Networks for Electronic Health Records: applications, evaluation measures and data sources
• Language-Driven Image Style Transfer
• Game of GANs: Game-Theoretical Models for Generative Adversarial Networks