Masked diffusion LLMs can use EoS tokens for hidden reasoning

Sarah Breckner, Sebastian Schuster

Diffusion LLMs have been proposed as an alternative to autoregressive LLMs. Curiously, they are especially capable if the generation length, i.e., the number of tokens the model ha…