activity
20232026
most citedVQ-LLM: High-performance Code Generation for Vector Quantization Augmented LLM Inference

11 citations · 14 across the 14 of their papers we have counts for

collaborators
Showing cs.DBShow all

1 paper · 1 filter

cs.DB2024★ 1 cited

The CAP Principle for LLM Serving: A Survey of Long-Context Large Language Model Serving

Pai Zeng, Zhenyu Ning, Jieru Zhao +5

We survey the large language model (LLM) serving area to understand the intricate dynamics between cost-efficiency and accuracy, which is magnified by the growing need for longer c…