2 citations · 3 across the 11 of their papers we have counts for
12 papers
Universal Visuo-Tactile Video Understanding for Embodied Interaction
Yifan Xie, Mingyang Li, Shoujie Li +5
Tactile perception is essential for embodied agents to understand physical attributes of objects that cannot be determined through visual inspection alone. While existing approache…
Audio-Driven Talking Face Video Generation with Joint Uncertainty Learning
Yifan Xie, Fei Ma, Yi Bin +2
Talking face video generation with arbitrary speech audio is a significant challenge within the realm of digital human technology. The previous studies have emphasized the signific…
MuseFace: Text-driven Face Editing via Diffusion-based Mask Generation Approach
Xin Zhang, Siting Huang, Xiangyang Luo +5
Face editing modifies the appearance of face, which plays a key role in customization and enhancement of personal images. Although much work have achieved remarkable success in tex…
Object Isolated Attention for Consistent Story Visualization
Xiangyang Luo, Junhao Cheng, Yifan Xie +5
Open-ended story visualization is a challenging task that involves generating coherent image sequences from a given storyline. One of the main difficulties is maintaining character…
STFTCodec: High-Fidelity Audio Compression through Time-Frequency Domain Representation
Tao Feng, Zhiyuan Zhao, Yifan Xie +4
We present STFTCodec, a novel spectral-based neural audio codec that efficiently compresses audio using Short-Time Fourier Transform (STFT). Unlike waveform-based approaches that r…
UniSync: A Unified Framework for Audio-Visual Synchronization
Tao Feng, Yifan Xie, Xun Guan +4
Precise audio-visual synchronization in speech videos is crucial for content quality and viewer comprehension. Existing methods have made significant strides in addressing this cha…
Fine-Grained Instruction-Guided Graph Reasoning for Vision-and-Language Navigation
Yaohua Liu, Binkai Ou, Rong Fu +2
Vision and Language Navigation (VLN) requires an embodied agent to traverse complex environments by following natural language instructions, demanding accurate alignment between vi…
PointTalk: Audio-Driven Dynamic Lip Point Cloud for 3D Gaussian-based Talking Head Synthesis
Yifan Xie, Tao Feng, Xin Zhang +6
Talking head synthesis with arbitrary speech audio is a crucial challenge in the field of digital humans. Recently, methods based on radiance fields have received increasing attent…
A Review of Human Emotion Synthesis Based on Generative Technology
Fei Ma, Yukan Li, Yifan Xie +8
Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the…
CCIS-Diff: A Generative Model with Stable Diffusion Prior for Controlled Colonoscopy Image Synthesis
Yifan Xie, Jingge Wang, Tao Feng +2
Colonoscopy is crucial for identifying adenomatous polyps and preventing colorectal cancer. However, developing robust models for polyp detection is challenging by the limited size…
GaussianPU: A Hybrid 2D-3D Upsampling Framework for Enhancing Color Point Clouds via 3D Gaussian Splatting
Zixuan Guo, Yifan Xie, Weijing Xie +3
Dense colored point clouds enhance visual perception and are of significant value in various robotic applications. However, existing learning-based point cloud upsampling methods a…
Generative Technology for Human Emotion Recognition: A Scope Review
Fei Ma, Yucheng Yuan, Yifan Xie +6
Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this…