1 citations · 1 across the 6 of their papers we have counts for
1 paper · 1 filter
Yifei Wang, Yueqi Wang, Zhenrui Yue +6
The deployment of Large Language Models (LLMs) faces a critical bottleneck when handling lengthy inputs: the prohibitive memory footprint of the Key Value (KV) cache. To address th…