Learning Light-Weight Translation Models from Deep Transformer

Bei Li, Ziyang Wang, Hui Liu +4

Recently, deep models have shown tremendous improvements in neural machine translation (NMT). However, systems of this kind are computationally expensive and memory intensive. In t…