Efficient Extraction of Noise-Robust Discrete Units from Self-Supervised Speech Models

Jakob Poncelet, Yujun Wang, Hugo Van hamme

Continuous speech can be converted into a discrete sequence by deriving discrete units from the hidden features of self-supervised learned (SSL) speech models. Although SSL models…