Improving generalizability of distilled self-supervised speech processing models under distorted settings

Kuan-Po Huang, Yu-Kuan Fu, Tsu-Yuan Hsu +5

Self-supervised learned (SSL) speech pre-trained models perform well across various speech processing tasks. Distilled versions of SSL models have been developed to match the needs…