NAVIRA: Decoupled Stochastic Remasking for Masked Diffusion Language Models

Andrey Fomenko, Maksim Kryzhanovskiy, Svetlana Glazyrina +1

Masked diffusion language models generate text by iteratively unmasking many tokens in parallel, but this speed comes with a correction problem: tokens generated in the same step a…