2 papers
cs.CL2023
RenewNAT: Renewing Potential Translation for Non-Autoregressive Transformer
Pei Guo, Yisheng Xiao, Juntao Li +1
Non-autoregressive neural machine translation (NAT) models are proposed to accelerate the inference process while maintaining relatively high performance. However, existing NAT mod…
cs.CL2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model
Yisheng Xiao, Ruiyang Xu, Lijun Wu +4
Transformer-based autoregressive (AR) methods have achieved appealing performance for varied sequence-to-sequence generation tasks, e.g., neural machine translation, summarization,…