3 citations · 3 across the 5 of their papers we have counts for
1 paper · 2 filters
Vinay Joshi, Prashant Laddha, Shambhavi Sinha +2
Excessive memory requirements of key and value features (KV-cache) present significant challenges in the autoregressive inference of large language models (LLMs), restricting both…