Combining Attention with Flow for Person Image Synthesis
arXiv:2108.01823
Abstract
Pose-guided person image synthesis aims to synthesize person images by transforming reference images into target poses. In this paper, we observe that the commonly used spatial transformation blocks have complementary advantages. We propose a novel model by combining the attention operation with the flow-based operation. Our model not only takes the advantage of the attention operation to generate accurate target structures but also uses the flow-based operation to sample realistic source textures. Both objective and subjective experiments demonstrate the superiority of our model. Meanwhile, comprehensive ablation studies verify our hypotheses and show the efficacy of the proposed modules. Besides, additional experiments on the portrait image editing task demonstrate the versatility of the proposed combination.
References in corpus (7)
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- VoxCeleb: a large-scale speaker identification dataset
- Improved Techniques for Training GANs
- Pose Guided Person Image Generation
- Multi-mapping Image-to-Image Translation via Learning Disentanglement
- Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlation