Regularized Context Gates on Transformer for Machine Translation

Xintong Li, Lemao Liu, Rui Wang +2

Context gates are effective to control the contributions from the source and target contexts in the recurrent neural network (RNN) based neural machine translation (NMT). However,…