46 citations · 99 across the 15 of their papers we have counts for
16 papers · 1 filter
Towards Fine-Grained Human Motion Video Captioning
Guorui Song, Guocun Wang, Zhe Huang +4
Generating accurate descriptions of human actions in videos remains a challenging task for video captioning models. Existing approaches often struggle to capture fine-grained motio…
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling
Haiyang Liu, Zihao Zhu, Giorgio Becherini +7
We propose EMAGE, a framework to generate full-body human gestures from audio and masked gestures, encompassing facial, local body, hands, and global movements. To achieve this, we…
Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry
Jiaxu Zhang, Junwu Weng, Di Kang +7
A good motion retargeting cannot be reached without reasonable consideration of source-target differences on both the skeleton and shape geometry levels. In this work, we propose a…
Audio2Gestures: Generating Diverse Gestures from Audio
Jing Li, Di Kang, Wenjie Pei +4
People may perform diverse gestures affected by various mental and physical factors when speaking the same sentences. This inherent one-to-many relationship makes co-speech gesture…
CARD: Semantic Segmentation with Efficient Class-Aware Regularized Decoder
Ye Huang, Di Kang, Liang Chen +5
Semantic segmentation has recently achieved notable advances by exploiting "class-level" contextual information during learning. However, these approaches simply concatenate class-…
NEURAL MARIONETTE: A Transformer-based Multi-action Human Motion Synthesis System
Weiqiang Wang, Xuefei Zhe, Qiuhong Ke +4
We present a neural network-based system for long-term, multi-action human motion synthesis. The system, dubbed as NEURAL MARIONETTE, can produce high-quality and meaningful motion…
Learning to Construct 3D Building Wireframes from 3D Line Clouds
Yicheng Luo, Jing Ren, Xuefei Zhe +4
Line clouds, though under-investigated in the previous work, potentially encode more compact structural information of buildings than point clouds extracted from multi-view images.…
WarpingGAN: Warping Multiple Uniform Priors for Adversarial 3D Point Cloud Generation
Yingzhi Tang, Yue Qian, Qijian Zhang +3
We propose WarpingGAN, an effective and efficient 3D point cloud generation network. Unlike existing methods that generate point clouds by directly learning the mapping functions b…
REALY: Rethinking the Evaluation of 3D Face Reconstruction
Zenghao Chai, Haoxian Zhang, Jing Ren +5
The evaluation of 3D face reconstruction results typically relies on a rigid shape alignment between the estimated 3D model and the ground-truth scan. We observe that aligning two…
CAR: Class-aware Regularizations for Semantic Segmentation
Ye Huang, Di Kang, Liang Chen +4
Recent segmentation methods, such as OCR and CPNet, utilizing "class level" information in addition to pixel features, have achieved notable success for boosting the accuracy of ex…
Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoders
Jing Li, Di Kang, Wenjie Pei +4
Generating conversational gestures from speech audio is challenging due to the inherent one-to-many mapping between audio and body motions. Conventional CNNs/RNNs assume one-to-one…
Animatable Neural Radiance Fields from Monocular RGB Videos
Jianchuan Chen, Ying Zhang, Di Kang +4
We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the d…
Model-based 3D Hand Reconstruction via Self-Supervised Learning
Yujin Chen, Zhigang Tu, Di Kang +5
Reconstructing a 3D hand from a single-view RGB image is challenging due to various hand configurations and depth ambiguity. To reliably reconstruct a 3D hand from a monocular imag…
High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies
Linchao Bao, Xiangkai Lin, Yajing Chen +9
We present a fully automatic system that can produce high-fidelity, photo-realistic 3D digital human heads with a consumer RGB-D selfie camera. The system only needs the user to ta…
Directional Statistics-based Deep Metric Learning for Image Classification and Retrieval
Xuefei Zhe, Shifeng Chen, Hong Yan
Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging…
Deep Class-Wise Hashing: Semantics-Preserving Hashing via Class-wise Loss
Xuefei Zhe, Shifeng Chen, Hong Yan
Deep supervised hashing has emerged as an influential solution to large-scale semantic image retrieval problems in computer vision. In the light of recent progress, convolutional n…