307 citations · 568 across the 44 of their papers we have counts for
30 papers · 1 filter
BayLing: Bridging Cross-lingual Alignment and Instruction Following through Interactive Translation for Large Language Models
Shaolei Zhang, Qingkai Fang, Zhuocheng Zhang +8
Large language models (LLMs) have demonstrated remarkable prowess in language understanding and generation. Advancing from foundation LLMs to instructionfollowing LLMs, instruction…
End-to-End Simultaneous Speech Translation with Differentiable Segmentation
Shaolei Zhang, Yang Feng
End-to-end simultaneous speech translation (SimulST) outputs translation while receiving the streaming speech inputs (a.k.a. streaming speech translation), and hence needs to segme…
Learning Optimal Policy for Simultaneous Machine Translation via Binary Search
Shoutao Guo, Shaolei Zhang, Yang Feng
Simultaneous machine translation (SiMT) starts to output translation while reading the source sentence and needs a precise policy to decide when to output the generated translation…
CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation
Yan Zhou, Qingkai Fang, Yang Feng
End-to-end speech translation (ST) is the task of translating speech signals in the source language into text in the target language. As a cross-modal task, end-to-end ST is diffic…
Back Translation for Speech-to-text Translation Without Transcripts
Qingkai Fang, Yang Feng
The success of end-to-end speech-to-text translation (ST) is often achieved by utilizing source transcripts, e.g., by pre-training with automatic speech recognition (ASR) and machi…
Understanding and Bridging the Modality Gap for Speech Translation
Qingkai Fang, Yang Feng
How to achieve better end-to-end speech translation (ST) by leveraging (text) machine translation (MT) data? Among various existing techniques, multi-task learning is one of the ef…