43 citations · 89 across the 16 of their papers we have counts for
16 papers
Joint Training And Decoding for Multilingual End-to-End Simultaneous Speech Translation
Wuwei Huang, Renren Jin, Wen Zhang +3
Recent studies on end-to-end speech translation(ST) have facilitated the exploration of multilingual end-to-end ST and end-to-end simultaneous ST. In this paper, we investigate end…
CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?
Tianwen Wei, Jian Luan, Wei Liu +2
We present the Chinese Elementary School Math Word Problems (CMATH) dataset, comprising 1.7k elementary school-level math word problems with detailed annotations, source from actua…
UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learning
Kang Zhao, Wei Liu, Jian Luan +4
Open-domain long-term memory conversation can establish long-term intimacy with humans, and the key is the ability to understand and memorize long-term dialogue history information…
Exploring Better Text Image Translation with Multimodal Codebook
Zhibin Lan, Jiawei Yu, Xiang Li +5
Text image translation (TIT) aims to translate the source texts embedded in the image to target translations, which has a wide range of applications and thus has important research…
Rethinking the Reasonability of the Test Set for Simultaneous Machine Translation
Mengge Liu, Wen Zhang, Xiang Li +4
Simultaneous machine translation (SimulMT) models start translation before the end of the source sentence, making the translation monotonically aligned with the source sentence. Ho…
BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation
Xiangyu Qin, Zhiyu Wu, Jinshi Cui +5
Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pret…
Improve Bilingual TTS Using Dynamic Language and Phonology Embedding
Fengyu Yang, Jian Luan, Yujun Wang
In most cases, bilingual TTS needs to handle three types of input scripts: first language only, second language only, and second language embedded in the first language. In the lat…
Improving Emotional Speech Synthesis by Using SUS-Constrained VAE and Text Encoder Aggregation
Fengyu Yang, Jian Luan, Yujun Wang
Learning emotion embedding from reference audio is a straightforward approach for multi-emotion speech synthesis in encoder-decoder systems. But how to get better emotion embedding…
PAMA-TTS: Progression-Aware Monotonic Attention for Stable Seq2Seq TTS With Accurate Phoneme Duration Control
Yunchao He, Jian Luan, Yujun Wang
Sequence expansion between encoder and decoder is a critical challenge in sequence-to-sequence TTS. Attention-based methods achieve great naturalness but suffer from unstable issue…
Msdtron: a high-capability multi-speaker speech synthesis system for diverse data using characteristic information
Qinghua Wu, Quanbo Shen, Jian Luan +1
In multi-speaker speech synthesis, data from a number of speakers usually tend to have great diversity due to the fact that the speakers may differ largely in ages, speaking styles…
HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis
Jiawei Chen, Xu Tan, Jian Luan +2
High-fidelity singing voices usually require higher sampling rate (e.g., 48kHz) to convey expression and emotion. However, higher sampling rate causes the wider frequency band and…
Transfer Learning for Improving Singing-voice Detection in Polyphonic Instrumental Music
Yuanbo Hou, Frank K. Soong, Jian Luan +1
Detecting singing-voice in polyphonic instrumental music is critical to music information retrieval. To train a robust vocal detector, a large dataset marked with vocal or non-voca…
PPSpeech: Phrase based Parallel End-to-End TTS System
Yahuan Cong, Ran Zhang, Jian Luan
Current end-to-end autoregressive TTS systems (e.g. Tacotron 2) have outperformed traditional parallel approaches on the quality of synthesized speech. However, they introduce new…
DeepSinger: Singing Voice Synthesis with Data Mined From the Web
Yi Ren, Xu Tan, Tao Qin +3
In this paper, we develop DeepSinger, a multi-lingual multi-singer singing voice synthesis (SVS) system, which is built from scratch using singing training data mined from music we…
Adversarially Trained Multi-Singer Sequence-To-Sequence Singing Synthesizer
Jie Wu, Jian Luan
This paper presents a high quality singing synthesizer that is able to model a voice with limited available recordings. Based on the sequence-to-sequence singing model, we design a…
XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis System
Peiling Lu, Jie Wu, Jian Luan +2
This paper presents XiaoiceSing, a high-quality singing voice synthesis system which employs an integrated network for spectrum, F0 and duration modeling. We follow the main archit…