1 citations · 2 across the 14 of their papers we have counts for
1 paper · 2 filters
Yuchong Wu, Zihuan Xu, Wangze Ni +5
The scaling of Large Language Model (LLM) services faces significant cost and latency challenges, making effective caching under tight capacity crucial. Existing cache replacement…