Transcribe, Translate, and Optimize: Joint Reward Learning for Speech Translation

Yanghe Dong, Wanting Huang, Weiran Wang

In LLM-based speech translation, transcription-based chain-of-thought (CoT) suffers from a mismatch between reference transcripts used in supervised fine-tuning (SFT) and model-gen…