Balancing Speech Understanding and Generation Using Continual Pre-training for Codec-based Speech LLM

Jiatong Shi, Chunlei Zhang, Jinchuan Tian +4

Recent advances in speech language models (LLMs) have extended textual LLMs to the speech domain, but balancing speech understanding and generation remains challenging, especially…