Essence Knowledge Distillation for Speech Recognition

Zhenchuan Yang, Chun Zhang, Weibin Zhang +2

It is well known that a speech recognition system that combines multiple acoustic models trained on the same data significantly outperforms a single-model system. Unfortunately, re…