Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Denoising Surface: Modeling and Predicting Inference Cost for Diffusion LLM Serving
Haoyu Zheng, Fangcheng Fu, Binhang Yuan +6
As diffusion large language models (dLLMs) become more capable, they are moving from research settings to real-world \textit{serving}, where request management (such as scheduling…
cs.LG2026
Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management
Haoyu Zheng, Fangcheng Fu, Jia Wu +6
LLM-based workflows compose specialized agents to execute complex tasks, and these agents usually share substantial context, allowing KV-Cache reuse to save computation. Existing a…