Showing cs.DCShow all
2 papers · 1 filter
cs.DC2025
xLLM Technical Report
Tongxuan Liu, Tao Peng, Peijun Yang +50
We introduce xLLM, an intelligent and efficient Large Language Model (LLM) inference framework designed for high-performance, large-scale enterprise-grade serving, with deep optimi…
cs.DC2024
Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution
Siqi Wang, Hailong Yang, Xuezhu Wang +10
Large language models (LLM) have recently attracted surging interest due to their outstanding capabilities across various domains. However, enabling efficient LLM inference is chal…