Integrated Multi-Level Knowledge Distillation for Enhanced Speaker Verification

Wenhao Yang, Jianguo Wei, Wenhuan Lu +2

Knowledge distillation (KD) is widely used in audio tasks, such as speaker verification (SV), by transferring knowledge from a well-trained large model (the teacher) to a smaller,…