SegAttnGAN: Text to Image Generation with Segmentation Attention
arXiv:2005.12444
Abstract
In this paper, we propose a novel generative network (SegAttnGAN) that utilizes additional segmentation information for the text-to-image synthesis task. As the segmentation data introduced to the model provides useful guidance on the generator training, the proposed model can generate images with better realism quality and higher quantitative measures compared with the previous state-of-art methods. We achieved Inception Score of 4.84 on the CUB dataset and 3.52 on the Oxford-102 dataset. Besides, we tested the self-attention SegAttnGAN which uses generated segmentation data instead of masks from datasets for attention and achieved similar high-quality results, suggesting that our model can be adapted for the text-to-image synthesis task.
arXiv commentAccepted to the AI for Content Creation Workshop at CVPR 2020
References in corpus (8)
- Conditional Generative Adversarial Nets
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Generative Adversarial Text to Image Synthesis
- Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Network
- Parallel Multiscale Autoregressive Density Estimation
- Object-driven Text-to-Image Synthesis via Adversarial Training
- Mask-Guided Portrait Editing with Conditional GANs