Recurrent Stacking of Layers for Compact Neural Machine Translation Models

Raj Dabre, Atsushi Fujita

In neural machine translation (NMT), the most common practice is to stack a number of recurrent or feed-forward layers in the encoder and the decoder. As a result, the addition of…