Knowledge Distillation Leveraging Alternative Soft Targets from Non-Parallel Qualified Speech Data

Tohru Nagano, Takashi Fukuda, Gakuto Kurata

This paper describes a novel knowledge distillation framework that leverages acoustically qualified speech data included in an existing training data pool as privileged information…