14 citations · 62 across the 22 of their papers we have counts for
22 papers
ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech
Xiaoran Fan, Chao Pang, Tian Yuan +9
Speech representation learning has improved both speech understanding and speech synthesis tasks for single language. However, its ability in cross-lingual scenarios has not been e…
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit
Hui Zhang, Tian Yuan, Junkun Chen +10
PaddleSpeech is an open-source all-in-one speech toolkit. It aims at facilitating the development and research of speech processing technologies by providing an easy-to-use command…
Data-Driven Adaptive Simultaneous Machine Translation
Guangxu Xun, Mingbo Ma, Yuchen Bian +7
In simultaneous translation (SimulMT), the most widely used strategy is the wait-k policy thanks to its simplicity and effectiveness in balancing translation quality and latency. H…
AT: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing
He Bai, Renjie Zheng, Junkun Chen +3
Recently, speech representation learning has improved many speech-related tasks such as speech recognition, speech classification, and speech-to-text translation. However, all the…
The Role of Phonetic Units in Speech Emotion Recognition
Jiahong Yuan, Xingyu Cai, Renjie Zheng +2
We propose a method for emotion recognition through emotiondependent speech recognition using Wav2vec 2.0. Our method achieved a significant improvement over most previously report…
Decoupling recognition and transcription in Mandarin ASR
Jiahong Yuan, Xingyu Cai, Dongji Gao +3
Much of the recent literature on automatic speech recognition (ASR) is taking an end-to-end approach. Unlike English where the writing system is closely related to sound, Chinese c…
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR
Junkun Chen, Mingbo Ma, Renjie Zheng +1
Simultaneous speech-to-text translation is widely useful in many scenarios. The conventional cascaded approach uses a pipeline of streaming ASR followed by simultaneous MT, but suf…
Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation
Renjie Zheng, Junkun Chen, Mingbo Ma +1
Recently, representation learning for text and speech has successfully improved many language related tasks. However, all existing methods suffer from two limitations: (a) they onl…
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training
Renjie Zheng, Mingbo Ma, Baigong Zheng +4
Simultaneous speech-to-speech translation is widely useful but extremely challenging, since it needs to generate target-language speech concurrently with the source-language speech…
MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation
Junkun Chen, Mingbo Ma, Renjie Zheng +1
End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded app…
Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings
Junkun Chen, Renjie Zheng, Atsuhito Kita +2
Simultaneous translation is vastly different from full-sentence translation, in the sense that it starts translation before the source sentence ends, with only a few words delay. H…
Opportunistic Decoding with Timely Correction for Simultaneous Translation
Renjie Zheng, Mingbo Ma, Baigong Zheng +2
Simultaneous translation has many important application scenarios and attracts much attention from both academia and industry recently. Most existing frameworks, however, have diff…
Simultaneous Translation Policies: From Fixed to Adaptive
Baigong Zheng, Kaibo Liu, Renjie Zheng +3
Adaptive policies are better than fixed policies for simultaneous translation, since they can flexibly balance the tradeoff between translation quality and latency based on the cur…
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework
Mingbo Ma, Baigong Zheng, Kaibo Liu +5
Text-to-speech synthesis (TTS) has witnessed rapid progress in recent years, where neural methods became capable of producing audios with high naturalness. However, these efforts s…
Speculative Beam Search for Simultaneous Translation
Renjie Zheng, Mingbo Ma, Baigong Zheng +1
Beam search is universally used in full-sentence translation but its application to simultaneous translation remains non-trivial, where output words are committed on the fly. In pa…
Simpler and Faster Learning of Adaptive Policies for Simultaneous Translation
Baigong Zheng, Renjie Zheng, Mingbo Ma +1
Simultaneous translation is widely useful but remains challenging. Previous work falls into two main categories: (a) fixed-latency policies such as Ma et al. (2019) and (b) adaptiv…
Robust Machine Translation with Domain Sensitive Pseudo-Sources: Baidu-OSU WMT19 MT Robustness Shared Task System Report
Renjie Zheng, Hairong Liu, Mingbo Ma +2
This paper describes the machine translation system developed jointly by Baidu Research and Oregon State University for WMT 2019 Machine Translation Robustness Shared Task. Transla…
Simultaneous Translation with Flexible Policy via Restricted Imitation Learning
Baigong Zheng, Renjie Zheng, Mingbo Ma +1
Simultaneous translation is widely useful but remains one of the most difficult tasks in NLP. Previous work either uses fixed-latency policies, or train a complicated two-staged mo…
Learning to Stop in Structured Prediction for Neural Machine Translation
Mingbo Ma, Renjie Zheng, Liang Huang
Beam search optimization resolves many issues in neural machine translation. However, this method lacks principled stopping criteria and does not learn how to stop during training,…
Ensemble Sequence Level Training for Multimodal MT: OSU-Baidu WMT18 Multimodal Machine Translation System Report
Renjie Zheng, Yilin Yang, Mingbo Ma +1
This paper describes multimodal machine translation systems developed jointly by Oregon State University and Baidu Research for WMT 2018 Shared Task on multimodal translation. In t…
Multi-Reference Training with Pseudo-References for Neural Translation and Text Generation
Renjie Zheng, Mingbo Ma, Liang Huang
Neural text generation, including neural machine translation, image captioning, and summarization, has been quite successful recently. However, during training time, typically only…
Same Representation, Different Attentions: Shareable Sentence Representation Learning from Multiple Tasks
Renjie Zheng, Junkun Chen, Xipeng Qiu
Distributed representation plays an important role in deep learning based natural language processing. However, the representation of a sentence often varies in different tasks, wh…