2 papers
cs.CL2022
Nearest Neighbor Knowledge Distillation for Neural Machine Translation
Zhixian Yang, Renliang Sun, Xiaojun Wan
k-nearest-neighbor machine translation (NN-MT), proposed by Khandelwal et al. (2021), has achieved many state-of-the-art results in machine translation tasks. Although effective, N…
cs.CL2022
Dependency-based Mixture Language Models
Zhixian Yang, Xiaojun Wan
Various models have been proposed to incorporate knowledge of syntactic structures into neural language models. However, previous works have relied heavily on elaborate components…