2 papers
cs.DC2026
SLO-Aware Compute Resource Allocation for Prefill-Decode Disaggregated LLM Inference
Luchang Li, Dongfang Li, Bozhao Gong +1
Prefill-Decode (P/D) disaggregation has emerged as a widely adopted optimization strategy for Large Language Model (LLM) inference. However, there currently exists no well-establis…
cs.CL2024
Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs
Luchang Li, Sheng Qian, Jie Lu +3
The Large Language Model (LLM) is widely employed for tasks such as intelligent assistants, text summarization, translation, and multi-modality on mobile phones. However, the curre…