578 citations · 2.9k across the 69 of their papers we have counts for
16 papers · 1 filter
DenoiSpeech: Denoising Text to Speech with Frame-Level Noise Modeling
Chen Zhang, Yi Ren, Xu Tan +5
While neural-based text to speech (TTS) models can synthesize natural and intelligible voice, they usually require high-quality speech data, which is costly to collect. In many sce…
SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint
Zhonghao Sheng, Kaitao Song, Xu Tan +4
Automatic song writing aims to compose a song (lyric and/or melody) by machine, which is an interesting topic in both academia and industry. In automatic song writing, lyric-to-mel…
DualLip: A System for Joint Lip Reading and Generation
Weicong Chen, Xu Tan, Yingce Xia +3
Lip reading aims to recognize text from talking lip, while lip generation aims to synthesize talking lip according to text, which is a key component in talking face generation and…
HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis
Jiawei Chen, Xu Tan, Jian Luan +2
High-fidelity singing voices usually require higher sampling rate (e.g., 48kHz) to convey expression and emotion. However, higher sampling rate causes the wider frequency band and…
PopMAG: Pop Music Accompaniment Generation
Yi Ren, Jinzheng He, Xu Tan +3
In pop music, accompaniments are usually played by multiple instruments (tracks) such as drum, bass, string and guitar, and can make a song more expressive and contagious by arrang…
LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition
Jin Xu, Xu Tan, Yi Ren +4
Speech synthesis (text to speech, TTS) and recognition (automatic speech recognition, ASR) are important speech tasks, and require a large amount of text and speech pairs for model…