most citedScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.DC2024★ 1 cited

ScaleLLM: A Resource-Frugal LLM Serving Framework by Optimizing End-to-End Efficiency

Yuhang Yao, Han Jin, Alay Dilipbhai Shah +7

Large language models (LLMs) have surged in popularity and are extensively used in commercial applications, where the efficiency of model serving is crucial for the user experience…