DiLaServe: High SLO Attainment Serving for Diffusion Language Models

Tzu-Tao Chang, Benjamin Yuanyang Hong, Kiet Pham +1

Diffusion language models (DLMs) have recently emerged as a promising alternative to conventional autoregressive language models. By generating multiple tokens in parallel during e…