On the Trainability of Masked Diffusion Language Models via Blockwise Locality

Yuxiang Wang, Yu Xiang, Baojian Zhou +4

Masked diffusion language models (MDMs) have recently emerged as a promising alternative to standard autoregressive large language models (AR-LLMs), yet their optimization can be s…