Text and Style Conditioned GAN for Generation of Offline Handwriting Lines

Abstract

This paper presents a GAN for generating images of handwritten lines conditioned on arbitrary text and latent style vectors. Unlike prior work, which produce stroke points or single-word images, this model generates entire lines of offline handwriting. The model produces variable-sized images by using style vectors to determine character widths. A generator network is trained with GAN and autoencoder techniques to learn style, and uses a pre-trained handwriting recognition network to induce legibility. A study using human evaluators demonstrates that the model produces images that appear to be written by a human. After training, the encoder network can extract a style vector from an image, allowing images in a similar style to be generated, but with arbitrary text.

Includes Supplementary Material. Accepted at BMVC 2020. 32 pages, 30 figures

References in corpus (4)

• Conditional Generative Adversarial Nets
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Neural Painters: A learned differentiable constraint for generating brushstroke paintings
• Unsupervised Doodling and Painting with Improved SPIRAL