PhonoVoxtLM: Exploring Single-Codebook Phonological Tokens for Speech Understanding and Generation

Mingrui Liang, Kentaro Onda, Shinji Watanabe

We investigate how speech token representations can support both understanding and generation within a unified speech language model. We present PhonoVoxtLM, built on the existing…