GANwriting: Content-Conditioned Generation of Styled Handwritten Word Images

Abstract

Although current image generation methods have reached impressive quality levels, they are still unable to produce plausible yet diverse images of handwritten words. On the contrary, when writing by hand, a great variability is observed across different writers, and even when analyzing words scribbled by the same individual, involuntary variations are conspicuous. In this work, we take a step closer to producing realistic and varied artificially rendered handwritten words. We propose a novel method that is able to produce credible handwritten word images by conditioning the generative process with both calligraphic style features and textual content. Our generator is guided by three complementary learning objectives: to produce realistic images, to imitate a certain handwriting style and to convey a specific textual content. Our model is unconstrained to any predefined vocabulary, being able to render whatever input word. Given a sample writer, it is also able to mimic its calligraphic features in a few-shot setup. We significantly advance over prior art and demonstrate with qualitative, quantitative and human-based evaluations the realistic aspect of our synthetically produced images.

arXiv commentAccepted to ECCV2020

References in corpus (11)

• Auto-Encoding Variational Bayes
• Conditional Generative Adversarial Nets
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• Conditional Image Synthesis With Auxiliary Classifier GANs
• A Neural Representation of Sketch Drawings
• Unsupervised Cross-Domain Image Generation
• Multimodal Unsupervised Image-to-Image Translation
• Generating Handwritten Chinese Characters using CycleGAN
• MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompaniment
• Few-Shot Unsupervised Image-to-Image Translation
• Generating Synthetic Data for Text Recognition