Nested Scale Editing for Conditional Image Synthesis
arXiv:2006.02038
Abstract
We propose an image synthesis approach that provides stratified navigation in the latent code space. With a tiny amount of partial or very low-resolution image, our approach can consistently out-perform state-of-the-art counterparts in terms of generating the closest sampled image to the ground truth. We achieve this through scale-independent editing while expanding scale-specific diversity. Scale-independence is achieved with a nested scale disentanglement loss. Scale-specific diversity is created by incorporating a progressive diversification constraint. We introduce semantic persistency across the scales by sharing common latent codes. Together they provide better control of the image synthesis process. We evaluate the effectiveness of our proposed approach through various tasks, including image outpainting, image superresolution, and cross-domain image translation.
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Spectral Normalization for Generative Adversarial Networks
- Progressive Growing of GANs for Improved Quality, Stability, and Variation
- ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
- Adversarial Feature Learning
- Disentangling by Factorising
- Adversarially Learned Inference
- EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning
- Invertible Conditional GANs for image editing