AMOM: Adaptive Masking over Masking for Conditional Masked Language Model

Yisheng Xiao, Ruiyang Xu, Lijun Wu +4

Transformer-based autoregressive (AR) methods have achieved appealing performance for varied sequence-to-sequence generation tasks, e.g., neural machine translation, summarization,…