Efficient Inference For Neural Machine Translation

Yi-Te Hsu, Sarthak Garg, Yi-Hsiu Liao +1

Large Transformer models have achieved state-of-the-art results in neural machine translation and have become standard in the field. In this work, we look for the optimal combinati…