Faster Nearest Neighbor Machine Translation

Shuhe Wang, Jiwei Li, Yuxian Meng +5

$k$NN based neural machine translation ($k$NN-MT) has achieved state-of-the-art results in a variety of MT tasks. One significant shortcoming of $k$NN-MT lies in its inefficiency i…