activity
20192023
most citedTowards Realistic Visual Dubbing with Heterogeneous Sources

34 citations · 121 across the 23 of their papers we have counts for

collaborators
Showing cs.SDShow all

5 papers · 1 filter

cs.SD2023★ 10 cited

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation

Jiawei Huang, Yi Ren, Rongjie Huang +7

Large diffusion models have been successful in text-to-audio (T2A) synthesis tasks, but they often suffer from common issues such as semantic misalignment and poor temporal consist…

cs.SD2023

CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-training

Zhenhui Ye, Rongjie Huang, Yi Ren +5

Improving text representation has attracted much attention to achieve expressive text-to-speech (TTS). However, existing works only implicitly learn the prosody with masked token r…

cs.SD2023

StyleS2ST: Zero-shot Style Transfer for Direct Speech-to-speech Translation

Kun Song, Yi Ren, Yi Lei +5

Direct speech-to-speech translation (S2ST) has gradually become popular as it has many advantages compared with cascade S2ST. However, current research mainly focuses on the accura…

cs.SD2021★ 2 cited

Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding

Chao Wang, Zhonghao Li, Benlai Tang +4

Recently, phonetic posteriorgrams (PPGs) based methods have been quite popular in non-parallel singing voice conversion systems. However, due to the lack of acoustic information in…

cs.SD2020★ 1 cited

PPG-based singing voice conversion with adversarial representation learning

Zhonghao Li, Benlai Tang, Xiang Yin +4

Singing voice conversion (SVC) aims to convert the voice of one singer to that of other singers while keeping the singing content and melody. On top of recent voice conversion work…