Optimus: Elastic Decoding for Efficient Diffusion LLM Serving

Chiyue Wei, Cong Guo, Bowen Duan +7

Large language model (LLM) serving is fundamentally limited by inefficient hardware utilization. Autoregressive (AR) decoding underutilizes GPUs due to its strictly sequential exec…