activity
20182023
most citedTowards Realistic Visual Dubbing with Heterogeneous Sources

34 citations · 57 across the 9 of their papers we have counts for

collaborators

9 papers

cs.SD2023★ 3 cited

TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection

Jie Liu, Zhiba Su, Hui Huang +5

Thanks to recent advancements in end-to-end speech modeling technology, it has become increasingly feasible to imitate and clone a user`s voice. This leads to a significant challen…

cs.MM2023

CPNet: Exploiting CLIP-based Attention Condenser and Probability Map Guidance for High-fidelity Talking Face Generation

Jingning Xu, Benlai Tang, Mingjie Wang +2

Recently, talking face generation has drawn ever-increasing attention from the research community in computer vision due to its arduous challenges and widespread application scenar…

cs.CV2022★ 34 cited

Towards Realistic Visual Dubbing with Heterogeneous Sources

Tianyi Xie, Liucheng Liao, Cheng Bi +7

The task of few-shot visual dubbing focuses on synchronizing the lip movements with arbitrary speech input for any talking head video. Albeit moderate improvements in current appro…

cs.CV2021

Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation

Jingning Xu, Benlai Tang, Mingjie Wang +4

Clothes style transfer for person video generation is a challenging task, due to drastic variations of intra-person appearance and video scenarios. To tackle this problem, most rec…

cs.SD2021★ 2 cited

Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding

Chao Wang, Zhonghao Li, Benlai Tang +4

Recently, phonetic posteriorgrams (PPGs) based methods have been quite popular in non-parallel singing voice conversion systems. However, due to the lack of acoustic information in…

cs.SD2020★ 1 cited

PPG-based singing voice conversion with adversarial representation learning

Zhonghao Li, Benlai Tang, Xiang Yin +4

Singing voice conversion (SVC) aims to convert the voice of one singer to that of other singers while keeping the singing content and melody. On top of recent voice conversion work…

cs.CL2020

Improving Accent Conversion with Reference Encoder and End-To-End Text-To-Speech

Wenjie Li, Benlai Tang, Xiang Yin +6

Accent conversion (AC) transforms a non-native speaker's accent into a native accent while maintaining the speaker's voice timbre. In this paper, we propose approaches to improving…

eess.AS2020★ 17 cited

ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoders

Yu Gu, Xiang Yin, Yonghui Rao +6

This paper presents ByteSing, a Chinese singing voice synthesis (SVS) system based on duration allocated Tacotron-like acoustic models and WaveRNN neural vocoders. Different from t…

eess.AS2018

Generative Adversarial Network based Speaker Adaptation for High Fidelity WaveNet Vocoder

Qiao Tian, Xucheng Wan, Shan Liu

Although state-of-the-art parallel WaveNet has addressed the issue of real-time waveform generation, there remains problems. Firstly, due to the noisy input signal of the model, th…