1 paper · 2 filters
Anton Xue, Litu Rout, Aditya Akella +3
Adapting a pretrained autoregressive (AR) model is a cost-efficient route to a diffusion language model (DLM). While nearly all such adaptations start from a full-attention transfo…