4 papers · 2 filters
Text2Lip: Progressive Lip-Synced Talking Face Generation from Text via Viseme-Guided Rendering
Xu Wang, Shengeng Tang, Fei Wang +4
Generating semantically coherent and visually accurate talking faces requires bridging the gap between linguistic meaning and facial articulation. Although audio-driven methods rem…
StgcDiff: Spatial-Temporal Graph Condition Diffusion for Sign Language Transition Generation
Jiashu He, Jiayi He, Shengeng Tang +3
Sign language transition generation seeks to convert discrete sign language segments into continuous sign videos by synthesizing smooth transitions. However,most existing methods m…
SignAligner: Harmonizing Complementary Pose Modalities for Coherent Sign Language Generation
Xu Wang, Shengeng Tang, Lechao Cheng +3
Sign language generation aims to produce diverse sign representations based on spoken language. However, achieving realistic and naturalistic generation remains a significant chall…
Learning Speaker-Invariant Visual Features for Lipreading
Yu Li, Feng Xue, Shujie Li +4
Lipreading is a challenging cross-modal task that aims to convert visual lip movements into spoken text. Existing lipreading methods often extract visual features that include spea…