RL Post-Training Diffusion Language Models Along Their Own Generation Paths

Vaibhav Singh, Eugene Belilovsky

Diffusion language models are a promising and more efficient alternative to autoregressive models. However, most RL post-training techniques are not easily adapted to these models.…