A Shape-Adaptive Architecture with Disaggregated Quantization for Efficient LLM Serving

Cong Guo, Chiyue Wei, Bowen Duan +5

Large language models (LLMs) have become the backbone of modern AI applications, but pose significant challenges for efficient inference. Their autoregressive generation divides ex…