Faster Transformer Decoding: N-gram Masked Self-Attention

Ciprian Chelba, Mia Chen, Ankur Bapna +1

Motivated by the fact that most of the information relevant to the prediction of target tokens is drawn from the source sentence $S=s_1,\dots ,s_S$, we propose truncating the tar…