Your Absorbing Discrete Diffusion Secretly Models the Bayesian Posterior

Cooper Doyle

Discrete diffusion language models learn to reconstruct text from randomly masked inputs, yet under mild assumptions their denoiser already implements the exact Bayesian posterior…