Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining

Xinnian Zhao, Chia-Hua Wu, Pu Wang +1

Speech-to-LLM systems often connect a frozen speech encoder to a frozen large language model (LLM) through a small trainable bridge. The bridge is usually treated as plumbing, but…