Learning Natural Conversational Behavior in Tandem Speech-to-Speech Models with Randomized Guidance

Manato Yaguchi, Yotaro Kubo, Hikaru Asano +1

Tandem speech-to-speech architectures couple a responsive speech frontend with an asynchronous text backend. In KAME, a large language model (LLM) serves as the backend, supplying…