Learning from imperfect teachers for low-resource acoustic generalization

Shuanglin Li, Ruxiao Qian, Jian Liu +3

Knowledge distillation (KD) improves low-resource acoustic learning by enriching one-hot supervision with the softened predictive distribution of a fixed teacher network. However,…