Deep Learning Technique for Human Parsing: A Survey and Outlook
arXiv:2301.00394 · doi:10.1007/s11263-024-02031-9
Abstract
Human parsing aims to partition humans in image or video into multiple pixel-level semantic parts. In the last decade, it has gained significantly increased interest in the computer vision community and has been utilized in a broad range of practical applications, from security monitoring, to social media, to visual special effects, just to name a few. Although deep learning-based human parsing solutions have made remarkable achievements, many important concepts, existing challenges, and potential research directions are still confusing. In this survey, we comprehensively review three core sub-tasks: single human parsing, multiple human parsing, and video human parsing, by introducing their respective task settings, background concepts, relevant problems and applications, representative literature, and datasets. We also present quantitative performance comparisons of the reviewed methods on benchmark datasets. Additionally, to promote sustainable development of the community, we put forward a transformer-based human parsing framework, providing a high-performance baseline for follow-up research through universal, concise, and extensible solutions. Finally, we point out a set of under-investigated open issues in this field and suggest new directions for future study. We also provide a regularly updated project page, to continuously track recent developments in this fast-advancing field: https://github.com/soeaver/awesome-human-parsing.
Accepted for publication in International Journal of Computer Vision (IJCV)
References in corpus (9)
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Learning Transferable Visual Models From Natural Language Supervision
- Deformable DETR: Deformable Transformers for End-to-End Object Detection
- SimSwap: An Efficient Framework For High Fidelity Face Swapping
- Per-Pixel Classification is Not All You Need for Semantic Segmentation
- A Survey on Long-Tailed Visual Recognition
- Joint-task Self-supervised Learning for Temporal Correspondence
- AIParsing: Anchor-free Instance-level Human Parsing
- Image Comes Dancing with Collaborative Parsing-Flow Video Synthesis