BlockServe: Block-Grained Continuous Batching for High-Throughput Diffusion LLM Serving

Yuanjie Zhu, Liangwei Yang, Ke Xu +4

Efficient serving of diffusion large language models (dLLMs) is hindered by convergence heterogeneity: when batching multiple requests, different sequences converge at different ra…