Decouple Non-parametric Knowledge Distillation For End-to-end Speech Translation

Hao Zhang, Nianwen Si, Yaqi Chen +4

Existing techniques often attempt to make knowledge transfer from a powerful machine translation (MT) to speech translation (ST) model with some elaborate techniques, which often r…