Denoising Surface: Modeling and Predicting Inference Cost for Diffusion LLM Serving

Haoyu Zheng, Fangcheng Fu, Binhang Yuan +6

As diffusion large language models (dLLMs) become more capable, they are moving from research settings to real-world \textit{serving}, where request management (such as scheduling…