activity
20232026
most citedInstInfer: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference

1 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2025

LouisKV: Efficient KV Cache Retrieval for Long Input-Output Sequences

Wenbo Wu, Qingyi Si, Xiurui Pan +2

While Key-Value (KV) cache succeeds in reducing redundant computations in auto-regressive models, it introduces significant memory overhead, limiting its practical deployment in lo…