DiffSoundStream: Efficient Speech Tokenization via Diffusion Decoding

Yang Yang, Yunpeng Li, George Sung +4

Token-based language modeling is a prominent approach for speech generation, where tokens are obtained by quantizing features from self-supervised learning (SSL) models and extract…