An Introduction to Image Synthesis with Generative Adversarial Nets

Abstract

There has been a drastic growth of research in Generative Adversarial Nets (GANs) in the past few years. Proposed in 2014, GAN has been applied to various applications such as computer vision and natural language processing, and achieves impressive performance. Among the many applications of GAN, image synthesis is the most well-studied one, and research in this area has already demonstrated the great potential of using GAN in image synthesis. In this paper, we provide a taxonomy of methods used in image synthesis, review different models for text-to-image synthesis and image-to-image translation, and discuss some evaluation metrics as well as possible future research directions in image synthesis with GAN.

References in corpus (51)

• Adam: A Method for Stochastic Optimization
• Conditional Generative Adversarial Nets
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Generative Adversarial Networks: An Overview
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Generative Adversarial Text to Image Synthesis
• Conditional Image Synthesis With Auxiliary Classifier GANs
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• Improved Training of Wasserstein GANs
• Improved Techniques for Training GANs
• LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
• NIPS 2016 Tutorial: Generative Adversarial Networks
• InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets
• A guide to convolution arithmetic for deep learning
• DRAW: A Recurrent Neural Network For Image Generation
• Energy-based Generative Adversarial Network
• Generating Videos with Scene Dynamics
• BEGAN: Boundary Equilibrium Generative Adversarial Networks
• Adversarial Feature Learning
• Adversarially Learned Inference
• Autoencoding beyond pixels using a learned similarity metric
• f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization
• Dual Learning for Machine Translation
• Invertible Conditional GANs for image editing
• Semi-Supervised Learning with Generative Adversarial Networks
• Unsupervised Image-to-Image Translation Networks
• Semantic Segmentation using Adversarial Networks
• Unsupervised Cross-Domain Image Generation
• Synthesizing the preferred inputs for neurons in neural networks via deep generator networks
• Neural Photo Editing with Introspective Adversarial Networks
• Mode Regularized Generative Adversarial Networks
• Loss Functions for Neural Networks for Image Processing
• Adversarial Learning for Neural Dialogue Generation
• LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation
• Long Text Generation via Adversarial Training with Leaked Information
• Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space
• Learning Deep Representations of Fine-grained Visual Descriptions
• Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesis
• TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network
• Adversarial Generation of Natural Language
• Safe and Nested Subgame Solving for Imperfect-Information Games
• Dynamic Routing Between Capsules
• Recurrent Topic-Transition GAN for Visual Paragraph Generation
• Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
• One-Sided Unsupervised Domain Mapping
• Stacked Generative Adversarial Networks
• Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner
• Semi-Supervised QA with Generative Domain-Adaptive Nets
• Learning Residual Images for Face Attribute Manipulation
• A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection

Cited by in corpus (25)

• Generative Adversarial Network in Medical Imaging: A Review
• Media Forensics and DeepFakes: an overview
• Deepfake Video Detection Using Convolutional Vision Transformer
• Interactive Image Generation Using Scene Graphs
• ARMANI: Part-level Garment-Text Alignment for Unified Cross-Modal Fashion Design
• Image Outpainting and Harmonization using Generative Adversarial Networks
• End-to-End Chinese Landscape Painting Creation Using Generative Adversarial Networks
• Text to Image Synthesis using Stacked Conditional Variational Autoencoders and Conditional Generative Adversarial Networks
• A Survey and Taxonomy of Adversarial Neural Networks for Text-to-Image Synthesis
• Editing in Style: Uncovering the Local Semantics of GANs
• Recent Advances of Image Steganography with Generative Adversarial Networks
• PaintBot: A Reinforcement Learning Approach for Natural Media Painting
• Cross-Vendor CT Image Data Harmonization Using CVH-CT
• Paint4Poem: A Dataset for Artistic Visualization of Classical Chinese Poems
• The Reincarnation of Grille Cipher: A Generative Approach
• LPaintB: Learning to Paint from Self-Supervision
• Generative Adversarial Network with Multi-Branch Discriminator for Cross-Species Image-to-Image Translation
• New Ideas and Trends in Deep Multimodal Content Understanding: A Review
• Neural style transfer of weak lensing mass maps
• STAN-CT: Standardizing CT Image using Generative Adversarial Network
• Fully Automated Image De-fencing using Conditional Generative Adversarial Networks
• CASS: Cross Adversarial Source Separation via Autoencoder
• GANILLA: Generative Adversarial Networks for Image to Illustration Translation
• A Statistician Teaches Deep Learning
• ReshapeGAN: Object Reshaping by Providing A Single Reference Image