Investigating Model Compression for Neural Machine Translation in the Biomedical Domain

Maria Zafar, Souhail Bakkali, Rejwanul Haque

Large-scale pretrained transformer models have achieved state-of-the-art performance across diverse machine translation tasks, including multilingual settings. Knowledge distillati…