Self-Evolution Knowledge Distillation for LLM-based Machine Translation

Yuncheng Song, Liang Ding, Changtong Zan +1

Knowledge distillation (KD) has shown great promise in transferring knowledge from larger teacher models to smaller student models. However, existing KD strategies for large langua…