The Implicit Length Bias of Label Smoothing on Beam Search Decoding

Bowen Liang, Pidong Wang, Yuan Cao

Label smoothing is ubiquitously applied in Neural Machine Translation (NMT) training. While label smoothing offers a desired regularization effect during model training, in this pa…