AntLM: Bridging Causal and Masked Language Models

Xinru Yu, Bin Guo, Shiwei Luo +3

Causal Language Modeling (CLM) and Masked Language Modeling (MLM) are two mainstream learning paradigms based on Transformer networks, specifically the Decoder-only and Encoder-onl…