Learned Relay Representations for Forward-Thinking Discrete Diffusion Models

Benjamin Rozonoyer, Jacopo Minniti, Dhruvesh Patel +4

When Masked Diffusion Models (MDMs) generate sequences through iterative refinement, the rich internal computation over masked positions is discarded, forcing every subsequent refi…