Creating a Good Teacher for Knowledge Distillation in Acoustic Scene Classification

Tobias Morocutti, Florian Schmid, Khaled Koutini +1

Knowledge Distillation (KD) is a widespread technique for compressing the knowledge of large models into more compact and efficient models. KD has proved to be highly effective in…