Transferable speech-to-text large language model alignment module

Boyong Wu, Chao Yan, Haoran Pu

By leveraging the power of Large Language Models(LLMs) and speech foundation models, state of the art speech-text bimodal works can achieve challenging tasks like spoken translatio…