416 citations · 640 across the 20 of their papers we have counts for
9 papers · 1 filter
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
Ziqiang Zhang, Long Zhou, Junyi Ao +4
The rapid development of single-modal pre-training has prompted researchers to pay more attention to cross-modal pre-training methods. In this paper, we propose a unified-modal spe…
Jointly Learning to Repair Code and Generate Commit Message
Jiaqi Bai, Long Zhou, Ambrosio Blanco +4
We propose a novel task of jointly repairing program codes and generating commit messages. Code repair and commit message generation are two essential and related tasks for softwar…
Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding
Yuchen Liu, Jiajun Zhang, Hao Xiong +5
Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional p…
Sequence Generation: From Both Sides to the Middle
Long Zhou, Jiajun Zhang, Chengqing Zong +1
The encoder-decoder framework has achieved promising process for many sequence generation tasks, such as neural machine translation and text summarization. Such a framework usually…
Synchronous Bidirectional Neural Machine Translation
Long Zhou, Jiajun Zhang, Chengqing Zong
Existing approaches to neural machine translation (NMT) generate the target language sequence token by token from left to right. However, this kind of unidirectional decoding frame…
Synchronous Bidirectional Inference for Neural Sequence Generation
Jiajun Zhang, Long Zhou, Yang Zhao +1
In sequence to sequence generation tasks (e.g. machine translation and abstractive summarization), inference is generally performed in a left-to-right manner to produce the result…