14 citations · 50 across the 22 of their papers we have counts for
22 papers
Direct Translation between Sign Languages
Zetian Wu, Bowen Xie, Wuyang Meng +3
Sign language translation has made substantial progress between sign and spoken languages, while translation across sign languages remains less explored. Translating directly betwe…
ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech
Xiaoran Fan, Chao Pang, Tian Yuan +9
Speech representation learning has improved both speech understanding and speech synthesis tasks for single language. However, its ability in cross-lingual scenarios has not been e…
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit
Hui Zhang, Tian Yuan, Junkun Chen +10
PaddleSpeech is an open-source all-in-one speech toolkit. It aims at facilitating the development and research of speech processing technologies by providing an easy-to-use command…
A Fast Attention Network for Joint Intent Detection and Slot Filling on Edge Devices
Liang Huang, Senjie Liang, Feiyang Ye +1
Intent detection and slot filling are two main tasks in natural language understanding and play an essential role in task-oriented dialogue systems. The joint learning of both task…
Data-Driven Adaptive Simultaneous Machine Translation
Guangxu Xun, Mingbo Ma, Yuchen Bian +7
In simultaneous translation (SimulMT), the most widely used strategy is the wait-k policy thanks to its simplicity and effectiveness in balancing translation quality and latency. H…
AT: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing
He Bai, Renjie Zheng, Junkun Chen +3
Recently, speech representation learning has improved many speech-related tasks such as speech recognition, speech classification, and speech-to-text translation. However, all the…
The Role of Phonetic Units in Speech Emotion Recognition
Jiahong Yuan, Xingyu Cai, Renjie Zheng +2
We propose a method for emotion recognition through emotiondependent speech recognition using Wav2vec 2.0. Our method achieved a significant improvement over most previously report…
Decoupling recognition and transcription in Mandarin ASR
Jiahong Yuan, Xingyu Cai, Dongji Gao +3
Much of the recent literature on automatic speech recognition (ASR) is taking an end-to-end approach. Unlike English where the writing system is closely related to sound, Chinese c…
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR
Junkun Chen, Mingbo Ma, Renjie Zheng +1
Simultaneous speech-to-text translation is widely useful in many scenarios. The conventional cascaded approach uses a pipeline of streaming ASR followed by simultaneous MT, but suf…
Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation
Renjie Zheng, Junkun Chen, Mingbo Ma +1
Recently, representation learning for text and speech has successfully improved many language related tasks. However, all existing methods suffer from two limitations: (a) they onl…
Context-aware Stand-alone Neural Spelling Correction
Xiangci Li, Hairong Liu, Liang Huang
Existing natural language processing systems are vulnerable to noisy inputs resulting from misspellings. On the contrary, humans can easily infer the corresponding correct words fr…
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training
Renjie Zheng, Mingbo Ma, Baigong Zheng +4
Simultaneous speech-to-speech translation is widely useful but extremely challenging, since it needs to generate target-language speech concurrently with the source-language speech…
MAM: Masked Acoustic Modeling for End-to-End Speech-to-Text Translation
Junkun Chen, Mingbo Ma, Renjie Zheng +1
End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded app…
Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings
Junkun Chen, Renjie Zheng, Atsuhito Kita +2
Simultaneous translation is vastly different from full-sentence translation, in the sense that it starts translation before the source sentence ends, with only a few words delay. H…
NEJM-enzh: A Parallel Corpus for English-Chinese Translation in the Biomedical Domain
Boxiang Liu, Liang Huang
Machine translation requires large amounts of parallel text. While such datasets are abundant in domains such as newswire, they are less accessible in the biomedical domain. Chines…
Opportunistic Decoding with Timely Correction for Simultaneous Translation
Renjie Zheng, Mingbo Ma, Baigong Zheng +2
Simultaneous translation has many important application scenarios and attracts much attention from both academia and industry recently. Most existing frameworks, however, have diff…
Simultaneous Translation Policies: From Fixed to Adaptive
Baigong Zheng, Kaibo Liu, Renjie Zheng +3
Adaptive policies are better than fixed policies for simultaneous translation, since they can flexibly balance the tradeoff between translation quality and latency based on the cur…
Machine Translation in Pronunciation Space
Hairong Liu, Mingbo Ma, Liang Huang
The research in machine translation community focus on translation in text space. However, humans are in fact also good at direct translation in pronunciation space. Some existing…
Incremental Text-to-Speech Synthesis with Prefix-to-Prefix Framework
Mingbo Ma, Baigong Zheng, Kaibo Liu +5
Text-to-speech synthesis (TTS) has witnessed rapid progress in recent years, where neural methods became capable of producing audios with high naturalness. However, these efforts s…
Speculative Beam Search for Simultaneous Translation
Renjie Zheng, Mingbo Ma, Baigong Zheng +1
Beam search is universally used in full-sentence translation but its application to simultaneous translation remains non-trivial, where output words are committed on the fly. In pa…
Simpler and Faster Learning of Adaptive Policies for Simultaneous Translation
Baigong Zheng, Renjie Zheng, Mingbo Ma +1
Simultaneous translation is widely useful but remains challenging. Previous work falls into two main categories: (a) fixed-latency policies such as Ma et al. (2019) and (b) adaptiv…
Group Sparse CNNs for Question Classification with Answer Sets
Mingbo Ma, Liang Huang, Bing Xiang +1
Question classification is an important task with wide applications. However, traditional techniques treat questions as general sentences, ignoring the corresponding answer data. I…