PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systems

Kentaro Mitsui, Koh Mitsuda, Toshiaki Wakatsuki +2

Multimodal language models that process both text and speech have a potential for applications in spoken dialogue systems. However, current models face two major challenges in resp…