3.2k citations · 7.6k across the 98 of their papers we have counts for
28 papers · 1 filter
Garment4D: Garment Reconstruction from Point Cloud Sequences
Fangzhou Hong, Liang Pan, Zhongang Cai +1
Learning to reconstruct 3D garments is important for dressing 3D human bodies of different shapes in different poses. Previous works typically rely on 2D images as input, which how…
Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completion
Tong Wu, Liang Pan, Junzhe Zhang +3
Chamfer Distance (CD) and Earth Mover's Distance (EMD) are two broadly adopted metrics for measuring the similarity between two point sets. However, CD is usually insensitive to mi…
Lifting 2D Human Pose to 3D with Domain Adapted 3D Body Concept
Qiang Nie, Ziwei Liu, Yunhui Liu
Lifting the 2D human pose to the 3D pose is an important yet challenging task. Existing 3D pose estimation suffers from 1) the inherent ambiguity between the 2D and 3D data, and 2)…
Robust Partial-to-Partial Point Cloud Registration in a Full Range
Liang Pan, Zhongang Cai, Ziwei Liu
Point cloud registration for 3D objects is a challenging task due to sparse and noisy measurements, incomplete observations and large transformations. In this work, we propose \tex…
Few-Shot Object Detection via Association and DIscrimination
Yuhang Cao, Jiaqi Wang, Ying Jin +4
Object detection has achieved substantial progress in the last decade. However, detecting novel classes with only few samples remains challenging, since deep learning under low dat…
Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinements
Yu Rong, Jingbo Wang, Ziwei Liu +1
3D interacting hand reconstruction is essential to facilitate human-machine interaction and human behaviors understanding. Previous works in this field either rely on auxiliary inp…
Generalized Out-of-Distribution Detection: A Survey
Jingkang Yang, Kaiyang Zhou, Yixuan Li +1
Out-of-distribution (OOD) detection is critical to ensuring the reliability and safety of machine learning systems. For instance, in autonomous driving, we would like the driving s…
Playing for 3D Human Recovery
Zhongang Cai, Mingyuan Zhang, Jiawei Ren +7
Image- and video-based 3D human recovery (i.e., pose and shape estimation) have achieved substantial progress. However, due to the prohibitive cost of motion capture, existing data…
TAda! Temporally-Adaptive Convolutions for Video Understanding
Ziyuan Huang, Shiwei Zhang, Liang Pan +4
Spatial convolutions are widely used in numerous deep video models. It fundamentally assumes spatio-temporal invariance, i.e., using shared weights for every location in different…
Talk-to-Edit: Fine-Grained Facial Editing via Dialog
Yuming Jiang, Ziqi Huang, Xingang Pan +2
Facial editing is an important task in vision and graphics with numerous applications. However, existing works are incapable to deliver a continuous and fine-grained editing mode (…
Learning to Prompt for Vision-Language Models
Kaiyang Zhou, Jingkang Yang, Chen Change Loy +1
Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different f…
Semantically Coherent Out-of-Distribution Detection
Jingkang Yang, Haoqi Wang, Litong Feng +4
Current out-of-distribution (OOD) detection benchmarks are commonly built by defining one dataset as in-distribution (ID) and all others as OOD. However, these benchmarks unfortuna…
Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency
Zhipeng Luo, Zhongang Cai, Changqing Zhou +7
Deep learning-based 3D object detection has achieved unprecedented success with the advent of large-scale autonomous driving datasets. However, drastic performance degradation rema…
Energy-Based Open-World Uncertainty Modeling for Confidence Calibration
Yezhen Wang, Bo Li, Tong Che +3
Confidence calibration is of great importance to the reliability of decisions made by machine learning systems. However, discriminative classifiers based on deep neural networks ar…
Robust Reference-based Super-Resolution via C2-Matching
Yuming Jiang, Kelvin C. K. Chan, Xintao Wang +2
Reference-based Super-Resolution (Ref-SR) has recently emerged as a promising paradigm to enhance a low-resolution (LR) input image by introducing an additional high-resolution (HR…
Unsupervised Object-Level Representation Learning from Scene Images
Jiahao Xie, Xiaohang Zhan, Ziwei Liu +2
Contrastive self-supervised learning has largely narrowed the gap to supervised pre-training on ImageNet. However, its success highly relies on the object-centric priors of ImageNe…
Delving Deep into the Generalization of Vision Transformers under Distribution Shifts
Chongzhi Zhang, Mingyuan Zhang, Shanghang Zhang +6
Vision Transformers (ViTs) have achieved impressive performance on various vision tasks, yet their generalization under distribution shifts (DS) is rarely understood. In this work,…
Semi-Supervised Domain Generalization with Stochastic StyleMatch
Kaiyang Zhou, Chen Change Loy, Ziwei Liu
Ideally, visual learning algorithms should be generalizable, for dealing with any unseen domain shift when deployed in a new target environment; and data-efficient, for reducing de…
PTeacher: a Computer-Aided Personalized Pronunciation Training System with Exaggerated Audio-Visual Corrective Feedback
Yaohua Bu, Tianyi Ma, Weijun Li +12
Second language (L2) English learners often find it difficult to improve their pronunciations due to the lack of expressive and personalized corrective feedback. In this paper, we…
Iterative Human and Automated Identification of Wildlife Images
Zhongqi Miao, Ziwei Liu, Kaitlyn M. Gaynor +3
Camera trapping is increasingly used to monitor wildlife, but this technology typically requires extensive data annotation. Recently, deep learning has significantly advanced autom…
Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation
Hang Zhou, Yasheng Sun, Wayne Wu +3
While accurate lip synchronization has been achieved for arbitrary-subject audio-driven talking face generation, the problem of how to efficiently drive the head pose remains. Prev…
Variational Relational Point Completion Network
Liang Pan, Xinyi Chen, Zhongang Cai +4
Real-scanned point clouds are often incomplete due to viewpoint, occlusion, and noise. Existing point cloud completion methods tend to generate global shape skeletons and hence lac…
Visually Informed Binaural Audio Generation without Binaural Audios
Xudong Xu, Hang Zhou, Ziwei Liu +3
Stereophonic audio, especially binaural audio, plays an essential role in immersive viewing environments. Recent research has explored generating visually guided stereophonic audio…
Deep Animation Video Interpolation in the Wild
Li Siyao, Shiyu Zhao, Weijiang Yu +4
In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time-consuming. Therefore, it is desirable to devel…