A Layer-Based Sequential Framework for Scene Generation with GANs
arXiv:1902.00671
Abstract
The visual world we sense, interpret and interact everyday is a complex composition of interleaved physical entities. Therefore, it is a very challenging task to generate vivid scenes of similar complexity using computers. In this work, we present a scene generation framework based on Generative Adversarial Networks (GANs) to sequentially compose a scene, breaking down the underlying problem into smaller ones. Different than the existing approaches, our framework offers an explicit control over the elements of a scene through separate background and foreground generators. Starting with an initially generated background, foreground objects then populate the scene one-by-one in a sequential manner. Via quantitative and qualitative experiments on a subset of the MS-COCO dataset, we show that our proposed framework produces not only more diverse images but also copes better with affine transformations and occlusion artifacts of foreground objects than its counterparts.
This paper was accepted at AAAI 2019
References in corpus (10)
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Conditional Image Synthesis With Auxiliary Classifier GANs
- Improved Techniques for Training GANs
- Toward Multimodal Image-to-Image Translation
- LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation
- ExprGAN: Facial Expression Editing with Controllable Expression Intensity
- MC-GAN: Multi-conditional Generative Adversarial Network for Image Synthesis
- Image Generation from Scene Graphs
- ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositing
- r-BTN: Cross-domain Face Composite and Synthesis from Limited Facial Patches