Improving Non-autoregressive Machine Translation with Error Exposure and Consistency Regularization

Xinran Chen, Sufeng Duan, Gongshen Liu

Being one of the IR-NAT (Iterative-refinemennt-based NAT) frameworks, the Conditional Masked Language Model (CMLM) adopts the mask-predict paradigm to re-predict the masked low-con…