Direct May Not Be the Best: An Incremental Evolution View of Pose Generation

Abstract

Pose diversity is an inherent representative characteristic of 2D images. Due to the 3D to 2D projection mechanism, there is evident content discrepancy among distinct pose images. This is the main obstacle bothering pose transformation related researches. To deal with this challenge, we propose a fine-grained incremental evolution centered pose generation framework, rather than traditional direct one-to-one in a rush. Since proposed approach actually bypasses the theoretical difficulty of directly modeling dramatic non-linear variation, the incurred content distortion and blurring could be effectively constrained, at the same time the various individual pose details, especially clothes texture, could be precisely maintained. In order to systematically guide the evolution course, both global and incremental evolution constraints are elaborately designed and merged into the overall framework. And a novel triple-path knowledge fusion structure is worked out to take full advantage of all available valuable knowledge to conduct high-quality pose synthesis. In addition, our framework could generate a series of valuable byproducts, namely the various intermediate poses. Extensive experiments have been conducted to verify the effectiveness of the proposed approach. Code is available at https://github.com/Xiaofei-CN/Incremental-Evolution-Pose-Generation.

Accepted at AAAI2024

References in corpus (9)

• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
• Progressive Pose Attention Transfer for Person Image Generation
• PISE: Person Image Synthesis and Editing with Decoupled GAN
• DwNet: Dense warp-based network for pose-guided human video generation
• Exploring Dual-task Correlation for Pose Guided Person Image Generation
• Cross Attention Based Style Distribution for Controllable Person Image Synthesis
• Learning Semantic Person Image Generation by Region-Adaptive Normalization
• Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesis