GSLM2: Multi-Stream Speech Representation Learning and Generative Spoken Language Modeling

Yosuke Higuchi, Tom Fizycki, Mahi Luthra +14

Generative spoken language models (SLMs) offer a route to learning linguistic structure purely from speech, yet they lag far behind text-based models in both capability and data sc…