PConv: Simple yet Effective Convolutional Layer for Generative Adversarial Network

Abstract

This paper presents a novel convolutional layer, called perturbed convolution (PConv), which focuses on achieving two goals simultaneously: improving the generative adversarial network (GAN) performance and alleviating the memorization problem in which the discriminator memorizes all images from a given dataset as training progresses. In PConv, perturbed features are generated by randomly disturbing an input tensor before performing the convolution operation. This approach is simple but surprisingly effective. First, to produce a similar output even with the perturbed tensor, each layer in the discriminator should learn robust features having a small local Lipschitz value. Second, since the input tensor is randomly perturbed during the training procedure like the dropout in neural networks, the memorization problem could be alleviated. To show the generalization ability of the proposed method, we conducted extensive experiments with various loss functions and datasets including CIFAR-10, CelebA, CelebA-HQ, LSUN, and tiny-ImageNet. The quantitative evaluations demonstrate that PConv effectively boosts the performance of GAN and conditional GAN in terms of Frechet inception distance (FID).

arXiv commentSubmitted to journal, arXiv admin note: text overlap with arXiv:1911.10979

References in corpus (21)

• Adam: A Method for Stochastic Optimization
• Conditional Generative Adversarial Nets
• mixup: Beyond Empirical Risk Minimization
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• Spectral Normalization for Generative Adversarial Networks
• Improved Regularization of Convolutional Neural Networks with Cutout
• Self-Attention Generative Adversarial Networks
• Generative Adversarial Text to Image Synthesis
• Conditional Image Synthesis With Auxiliary Classifier GANs
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
• Which Training Methods for GANs do actually Converge?
• A Learned Representation For Artistic Style
• cGANs with Projection Discriminator
• On Data Augmentation for GAN Training
• On Convergence and Stability of GANs
• PEPSI++: Fast and Lightweight Network for Image Inpainting
• Image Augmentations for GAN Training
• Consistency Regularization for Generative Adversarial Networks
• Simple yet Effective Way for Improving the Performance of GAN