Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation

Daxin Tan, Dehua Tao, Chengxi Deng +2

Autoregressive generation of interleaved text and acoustic tokens is a common approach to spoken-response generation in speech large language models. Although this design enables s…