2 citations · 2 across the 20 of their papers we have counts for
17 papers · 1 filter
Xemo-Talker: Unlock Emotions Explicitly for Audio-Driven Talking Portrait Synthesis
Chaolong Yang, Yinuo Guo, Kai Yao +6
Precise emotion control in audio-driven talking heads remains a challenge due to the reliance on implicit emotion regulation in existing systems, which often leads to indirect and…
Rethinking Gradient Modulation in Multimodal Regression
Haojie Yin, Chengcheng Feng, Tianyi Liu +2
Even balanced multimodal learning methods do not consistently translate additional modalities into better regression performance. To understand this limitation, we revisit the opti…
Unlock Pose Diversity: Accurate and Efficient Implicit Keypoint-based Spatiotemporal Diffusion for Audio-driven Talking Portrait
Chaolong Yang, Kai Yao, Yuyao Yan +7
Audio-driven single-image talking portrait generation plays a crucial role in virtual reality, digital human creation, and filmmaking. Existing approaches are generally categorized…
BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysis
Weiguang Zhao, Rui Zhang, Qiufeng Wang +2
3D semantic segmentation plays a fundamental and crucial role to understand 3D scenes. While contemporary state-of-the-art techniques predominantly concentrate on elevating the ove…
Consistency Diffusion Models for Single-Image 3D Reconstruction with Priors
Chenru Jiang, Chengrui Zhang, Xi Yang +4
This paper delves into the study of 3D point cloud reconstruction from a single image. Our objective is to develop the Consistency Diffusion Model, exploring synergistic 2D and 3D…
HOMER: Homography-Based Efficient Multi-view 3D Object Removal
Jingcheng Ni, Weiguang Zhao, Daniel Wang +4
3D object removal is an important sub-task in 3D scene editing, with broad applications in scene understanding, augmented reality, and robotics. However, existing methods struggle…
Towards Training-Free Open-World Classification with 3D Generative Models
Xinzhe Xia, Weiguang Zhao, Yuyao Yan +4
3D open-world classification is a challenging yet essential task in dynamic and unstructured real-world scenarios, requiring both open-category and open-pose recognition. To addres…
PO3AD: Predicting Point Offsets toward Better 3D Point Cloud Anomaly Detection
Jianan Ye, Weiguang Zhao, Xi Yang +2
Point cloud anomaly detection under the anomaly-free setting poses significant challenges as it requires accurately capturing the features of 3D normal data to identify deviations…
MedMAP: Promoting Incomplete Multi-modal Brain Tumor Segmentation with Alignment
Tianyi Liu, Zhaorui Tan, Muyin Chen +3
Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more…
Generalized W-Net: Arbitrary-style Chinese Character Synthesization
Haochuan Jiang, Guanyu Yang, Fei Cheng +1
Synthesizing Chinese characters with consistent style using few stylized examples is challenging. Existing models struggle to generate arbitrary style characters with limited examp…
W-Net: One-Shot Arbitrary-Style Chinese Character Generation with Deep Neural Networks
Haochuan Jiang, Guanyu Yang, Kaizhu Huang +1
Due to the huge category number, the sophisticated combinations of various strokes and radicals, and the free writing or printing styles, generating Chinese characters with diverse…
Revisiting Mutual Information Maximization for Generalized Category Discovery
Zhaorui Tan, Chengrui Zhang, Xi Yang +2
Generalized category discovery presents a challenge in a realistic scenario, which requires the model's generalization ability to recognize unlabeled samples from known and unknown…
SCMix: Stochastic Compound Mixing for Open Compound Domain Adaptation in Semantic Segmentation
Kai Yao, Zhaorui Tan, Zixian Su +3
Open compound domain adaptation (OCDA) aims to transfer knowledge from a labeled source domain to a mix of unlabeled homogeneous compound target domains while generalizing to open…
Rethinking Information Loss in Medical Image Segmentation with Various-sized Targets
Tianyi Liu, Zhaorui Tan, Kaizhu Huang +1
Medical image segmentation presents the challenge of segmenting various-size targets, demanding the model to effectively capture both local and global information. Despite recent e…
Semantic-aware Data Augmentation for Text-to-image Synthesis
Zhaorui Tan, Xi Yang, Kaizhu Huang
Data augmentation has been recently leveraged as an effective regularizer in various vision-language deep neural networks. However, in text-to-image synthesis (T2Isyn), current aug…
Diff-Oracle: Deciphering Oracle Bone Scripts with Controllable Diffusion Model
Jing Li, Qiu-Feng Wang, Siyuan Wang +3
Deciphering oracle bone scripts plays an important role in Chinese archaeology and philology. However, a significant challenge remains due to the scarcity of oracle character image…
Open-Pose 3D Zero-Shot Learning: Benchmark and Challenges
Weiguang Zhao, Guanyu Yang, Rui Zhang +5
With the explosive 3D data growth, the urgency of utilizing zero-shot learning to facilitate data labeling becomes evident. Recently, methods transferring language or language-imag…