Towards domain generalisation in ASR with elitist sampling and ensemble knowledge distillation

Rehan Ahmad, Md Asif Jalal, Muhammad Umar Farooq +2

Knowledge distillation has widely been used for model compression and domain adaptation for speech applications. In the presence of multiple teachers, knowledge can easily be trans…