In-training Matrix Factorization for Parameter-frugal Neural Machine Translation

Zachary Kaden, Teven Le Scao, Raphael Olivier

In this paper, we propose the use of in-training matrix factorization to reduce the model size for neural machine translation. Using in-training matrix factorization, parameter mat…