Sketch-to-Art: Synthesizing Stylized Art Images From Sketches
arXiv:2002.12888
Abstract
We propose a new approach for synthesizing fully detailed art-stylized images from sketches. Given a sketch, with no semantic tagging, and a reference image of a specific style, the model can synthesize meaningful details with colors and textures. The model consists of three modules designed explicitly for better artistic style capturing and generation. Based on a GAN framework, a dual-masked mechanism is introduced to enforce the content constraints (from the sketch), and a feature-map transformation technique is developed to strengthen the style consistency (to the reference image). Finally, an inverse procedure of instance-normalization is proposed to disentangle the style and content information, therefore yields better synthesis performance. Experiments demonstrate a significant qualitative and quantitative boost over baselines based on previous state-of-the-art techniques, adopted for the proposed process.
arXiv comment24 pages
References in corpus (9)
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Instance Normalization: The Missing Ingredient for Fast Stylization
- Conditional Image Synthesis With Auxiliary Classifier GANs
- Toward Multimodal Image-to-Image Translation
- cGANs with Projection Discriminator
- Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
- CAN: Creative Adversarial Networks, Generating "Art" by Learning About Styles and Deviating from Style Norms
- Neural Style Transfer: A Review
- Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Generative Adversarial Networks