Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs

Amr Hendy, Esraa A. Gad, Mohamed Abdelghaffar +4

This paper describes our submission to the constrained track of WMT21 shared news translation task. We focus on the three relatively low resource language pairs Bengali to and from…