CoPE: Conditional image generation using Polynomial Expansions
arXiv:2104.05077
Abstract
Generative modeling has evolved to a notable field of machine learning. Deep polynomial neural networks (PNNs) have demonstrated impressive results in unsupervised image generation, where the task is to map an input vector (i.e., noise) to a synthesized image. However, the success of PNNs has not been replicated in conditional generation tasks, such as super-resolution. Existing PNNs focus on single-variable polynomial expansions which do not fare well to two-variable inputs, i.e., the noise variable and the conditional variable. In this work, we introduce a general framework, called CoPE, that enables a polynomial expansion of two input variables and captures their auto- and cross-correlations. We exhibit how CoPE can be trivially augmented to accept an arbitrary number of input variables. CoPE is evaluated in five tasks (class-conditional generation, inverse problems, edges-to-image translation, image-to-image translation, attribute-guided generation) involving eight datasets. The thorough evaluation suggests that CoPE can be useful for tackling diverse conditional generation tasks. The source code of CoPE is available at \url{https://github.com/grigorisg9gr/polynomial_nets_for_conditional_generation}.
arXiv commentAccepted in NeurIPS 2021
References in corpus (16)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Auto-Encoding Variational Bayes
- Generative Adversarial Networks: An Overview
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Spectral Normalization for Generative Adversarial Networks
- Conditional Image Synthesis With Auxiliary Classifier GANs
- A Learned Representation For Artistic Style
- Pose Guided Person Image Generation
- Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
- DRIT++: Diverse Image-to-Image Translation via Disentangled Representations
- Diversity-Sensitive Conditional Generative Adversarial Networks
- On Self Modulation for Generative Adversarial Networks
- An Application of Generative Adversarial Networks for Super Resolution Medical Imaging
- Harmonizing Maximum Likelihood with GANs for Multimodal Conditional Generation
- PolyGAN: High-Order Polynomial Generators
- Multilinear Latent Conditioning for Generating Unseen Attribute Combinations