31 citations · 35 across the 13 of their papers we have counts for
1 paper · 1 filter
Pai Zeng, Zhenyu Ning, Jieru Zhao +5
We survey the large language model (LLM) serving area to understand the intricate dynamics between cost-efficiency and accuracy, which is magnified by the growing need for longer c…