3D Human Texture Estimation from a Single Image with Transformers
arXiv:2109.02563
Abstract
We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the input image, overcoming the limitations of existing methods that are solely based on convolutional neural networks. In addition, we also propose a mask-fusion strategy to combine the advantages of the RGB-based and texture-flow-based models. We further introduce a part-style loss to help reconstruct high-fidelity colors without introducing unpleasant artifacts. Extensive experiments demonstrate the effectiveness of the proposed method against state-of-the-art 3D human texture estimation approaches both quantitatively and qualitatively.
arXiv commentICCV 2021 Oral, Project: https://www.mmlab-ntu.com/project/texformer, Code: https://github.com/xuxy09/Texformer
References in corpus (18)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Learning from Synthetic Humans
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
- Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)
- Pre-Trained Image Processing Transformer
- Torchreid: A Library for Deep Learning Person Re-Identification in Pytorch
- End-to-end Recovery of Human Shape and Pose
- Analysis of approximate nearest neighbor searching with clustered point sets
- Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising
- Quadratic video interpolation
- EANet: Enhancing Alignment for Cross-Domain Person Re-identification
- Video Based Reconstruction of 3D People Models
- Learning to Reconstruct People in Clothing from a Single RGB Camera
- ARCH: Animatable Reconstruction of Clothed Humans
- Detailed Human Avatars from Monocular Video
- TexMesh: Reconstructing Detailed Human Texture and Geometry from RGB-D Video
- Re-Identification Supervised Texture Generation
- Reconstructing NBA Players