SD-HuBERT: Sentence-Level Self-Distillation Induces Syllabic Organization in HuBERT

Cheol Jun Cho, Abdelrahman Mohamed, Shang-Wen Li +2

Data-driven unit discovery in self-supervised learning (SSL) of speech has embarked on a new era of spoken language processing. Yet, the discovered units often remain in phonetic s…