CanvasGAN: A simple baseline for text to image generation by incrementally patching a canvas
arXiv:1810.02833
Abstract
We propose a new recurrent generative model for generating images from text captions while attending on specific parts of text captions. Our model creates images by incrementally adding patches on a "canvas" while attending on words from text caption at each timestep. Finally, the canvas is passed through an upscaling network to generate images. We also introduce a new method for generating visual-semantic sentence embeddings based on self-attention over text. We compare our model's generated images with those generated Reed et. al.'s model and show that our model is a stronger baseline for text to image generation tasks.
arXiv commentCVC 2019
References in corpus (12)
- Efficient Estimation of Word Representations in Vector Space
- Neural Machine Translation by Jointly Learning to Align and Translate
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Self-Attention Generative Adversarial Networks
- Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
- Generative Adversarial Text to Image Synthesis
- Conditional Image Generation with PixelCNN Decoders
- Improved Training of Wasserstein GANs
- Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models
- DRAW: A Recurrent Neural Network For Image Generation
- Neural Photo Editing with Introspective Adversarial Networks
- Generating Images from Captions with Attention