Transfer Learning for Text Diffusion Models

Kehang Han, Kathleen Kenealy, Aditya Barua +2

In this report, we explore the potential for text diffusion to replace autoregressive (AR) decoding for the training and deployment of large language models (LLMs). We are particul…