activity
20222026
most citedEfficient Monotonic Multihead Attention

5 citations · 15 across the 18 of their papers we have counts for

collaborators

19 papers

cs.CL2026

AutoTerm-SST: Adaptive Terminology Memory with Zero Session-Time Setup for Streaming Speech Translation

Jiaxuan Luo, Siqi Ouyang, Lei Li

Retrieval-augmented speech translation improves rare terminology, but systems such as RASST still assume that users provide a glossary before each session. That assumption is incon…

cs.CL2026

A Practical Evaluation Method for Long-Form Simultaneous Speech-to-Speech Translation

Yulin Xue, Siqi Ouyang, Lei Li

Simultaneous speech-to-speech translation (SimulS2ST) enables real-time cross-lingual communication, but existing evaluation has focused largely on short or pre-segmented speech ra…

cs.CL2026

Hierarchical Policy Optimization for Simultaneous Translation of Unbounded Speech

Siqi Ouyang, Shuoyang Ding, Oleksii Hrinchuk +4

Simultaneous speech translation (SST) generates translations while receiving partial speech input. Recent advances show that large language models (LLMs) can substantially improve…

cs.CL2026

Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translation

Yifeng Liu, Siqi Ouyang, Yatish Hosmane Revanasiddappa +1

Large Language Models (LLMs) have demonstrated remarkable capability in machine translation on high-resource language pairs, yet their performance on low-resource translation still…

cs.CL2026

RASST: Retrieval-Augmented Simultaneous Speech Translation

Jiaxuan Luo, Siqi Ouyang, Jiaxing Xu +1

Simultaneous speech translation produces target text incrementally from partial speech input. Recent speech large language models have markedly improved SST quality but still strug…

cs.CL2025

CMU's IWSLT 2025 Simultaneous Speech Translation System

Siqi Ouyang, Xi Xu, Lei Li

This paper presents CMU's submission to the IWSLT 2025 Simultaneous Speech Translation (SST) task for translating unsegmented English speech into Chinese and German text in a strea…

cs.CL2025

InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Model

Siqi Ouyang, Xi Xu, Lei Li

Simultaneous translation of unbounded streaming speech remains a challenging problem due to the need for effectively processing the history speech context and past translations so…

cs.CL2024

CA*: Addressing Evaluation Pitfalls in Computation-Aware Latency for Simultaneous Speech Translation

Xi Xu, Wenda Xu, Siqi Ouyang +1

Simultaneous speech translation (SimulST) systems must balance translation quality with response time, making latency measurement crucial for evaluating their real-world performanc…

cs.CL2024

Translation Canvas: An Explainable Interface to Pinpoint and Analyze Translation Systems

Chinmay Dandekar, Wenda Xu, Xi Xu +2

With the rapid advancement of machine translation research, evaluation toolkits have become essential for benchmarking system progress. Tools like COMET and SacreBLEU offer single…

cs.CL2024

Anticipating Future with Large Language Model for Simultaneous Machine Translation

Siqi Ouyang, Oleksii Hrinchuk, Zhehuai Chen +4

Simultaneous machine translation (SMT) takes streaming input utterances and incrementally produces target text. Existing SMT methods mainly use the partial utterance that has alrea…

cs.CL2024★ 1 cited

FASST: Fast LLM-based Simultaneous Speech Translation

Siqi Ouyang, Xi Xu, Chinmay Dandekar +1

Simultaneous speech translation (SST) takes streaming speech input and generates text translation on the fly. Existing methods either have high latency due to recomputation of inpu…

cs.CL2024

CMU's IWSLT 2024 Simultaneous Speech Translation System

Xi Xu, Siqi Ouyang, Brian Yan +5

This paper describes CMU's submission to the IWSLT 2024 Simultaneous Speech Translation (SST) task for translating English speech to German text in a streaming manner. Our end-to-e…

q-bio.BM2024★ 1 cited

Structure-Based Drug Design via 3D Molecular Generative Pre-training and Sampling

Yuwei Yang, Siqi Ouyang, Xueyu Hu +3

Structure-based drug design aims at generating high affinity ligands with prior knowledge of 3D target structures. Existing methods either use conditional generative model to learn…

cs.CL2023★ 5 cited

Efficient Monotonic Multihead Attention

Xutai Ma, Anna Sun, Siqi Ouyang +2

We introduce the Efficient Monotonic Multihead Attention (EMMA), a state-of-the-art simultaneous translation model with numerically-stable and unbiased monotonic alignment estimati…

cs.CL2023★ 1 cited

AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Models

Siqi Ouyang, Lei Li

Recent large language models (LLMs) are promising for making decisions in grounded environments. However, LLMs frequently fail in complex decision-making tasks due to the misalignm…

cs.CL2022★ 2 cited

WACO: Word-Aligned Contrastive Learning for Speech Translation

Siqi Ouyang, Rong Ye, Lei Li

End-to-end Speech Translation (E2E ST) aims to directly translate source speech into target text. Existing ST methods perform poorly when only extremely small speech-text data are…

cs.CL2022★ 3 cited

Pre-trained Language Models Can be Fully Zero-Shot Learners

Xuandong Zhao, Siqi Ouyang, Zhiguo Yu +2

How can we extend a pre-trained model to many language understanding tasks, without labeled or additional unlabeled data? Pre-trained language models (PLMs) have been effective for…

cs.CL2022

Structured Knowledge Grounding for Question Answering

Yujie Lu, Siqi Ouyang, Kairui Zhou

Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen som…

cs.CL2022★ 2 cited

On the Impact of Noises in Crowd-Sourced Data for Speech Translation

Siqi Ouyang, Rong Ye, Lei Li

Training speech translation (ST) models requires large and high-quality datasets. MuST-C is one of the most widely used ST benchmark datasets. It contains around 400 hours of speec…