Self-Speculative Biased Decoding for Faster Re-Translation

Linxiao Zeng, Haoyun Deng, Kangyuan Shu +1

Large language models achieve strong machine translation quality but incur high inference cost and latency, posing challenges for simultaneous translation. Re-translation provides…