Extracting Training Data from Diffusion Language Models via Infilling

Yihan Wang, N. Asokan

Memorization in large language models has been studied almost exclusively through prefix-conditioned extraction, a natural choice for autoregressive models. However, diffusion lang…