Noise robust distillation of self-supervised speech models via correlation metrics

Fabian Ritter-Gutierrez, Kuan-Po Huang, Dianwen Ng +4

Compared to large speech foundation models, small distilled models exhibit degraded noise robustness. The student's robustness can be improved by introducing noise at the inputs du…