Nemotron-Labs-TwoTower: Diffusion Language Modeling with Pretrained Autoregressive Context

Fitsum Reda, John Kamalu, Roger Waleffe +3

Diffusion language models offer a promising alternative to autoregressive models due to their potential for parallel and iterative generation. However, existing approaches use a si…