An Interpretable Generative Model for Handwritten Digit Image Synthesis

Abstract

An interpretable generative model for handwritten digits synthesis is proposed in this work. Modern image generative models, such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), are trained by backpropagation (BP). The training process is complex and the underlying mechanism is difficult to explain. We propose an interpretable multi-stage PCA method to achieve the same goal and use handwritten digit images synthesis as an illustrative example. First, we derive principal-component-analysis-based (PCA-based) transform kernels at each stage based on the covariance of its inputs. This results in a sequence of transforms that convert input images of correlated pixels to spectral vectors of uncorrelated components. In other words, it is a whitening process. Then, we can synthesize an image based on random vectors and multi-stage transform kernels through a coloring process. The generative model is a feedforward (FF) design since no BP is used in model parameter determination. Its design complexity is significantly lower, and the whole design process is explainable. Finally, we design an FF generative model using the MNIST dataset, compare synthesis results with those obtained by state-of-the-art GAN and VAE methods, and show that the proposed generative model achieves comparable performance.

References in corpus (14)

• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models
• Pixel Recurrent Neural Networks
• DRAW: A Recurrent Neural Network For Image Generation
• Energy-based Generative Adversarial Network
• Generating Videos with Scene Dynamics
• Towards Principled Methods for Training Generative Adversarial Networks
• Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis
• Attend, Infer, Repeat: Fast Scene Understanding with Generative Models
• LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation
• IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis
• Learning Hierarchical Features from Generative Models
• Generating Images Part by Part with Composite Generative Adversarial Networks
• Interpretable Convolutional Neural Networks via Feedforward Design