A Modular-based Strategy for Mitigating Gradient Conflicts in Simultaneous Speech Translation

Xiaoqian Liu, Yangfan Du, Jianjin Wang +5

Simultaneous Speech Translation (SimulST) involves generating target language text while continuously processing streaming speech input, presenting significant real-time challenges…