1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Lian Liu, Shixin Zhao, Yutian Zhou +4
The widespread adoption of Large Language Models (LLMs) has exponentially increased the demand for efficient serving systems. With growing requests and context lengths, key-value (…