activity
20232026
most citedInstInfer: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference

1 citations · 2 across the 5 of their papers we have counts for

collaborators
Showing 2025Show all

2 papers · 1 filter

cs.LG2025

LouisKV: Efficient KV Cache Retrieval for Long Input-Output Sequences

Wenbo Wu, Qingyi Si, Xiurui Pan +2

While Key-Value (KV) cache succeeds in reducing redundant computations in auto-regressive models, it introduces significant memory overhead, limiting its practical deployment in lo…

cs.OS2025★ 1 cited

XBOF: A Cost-Efficient CXL JBOF with Inter-SSD Compute Resource Sharing

Shushu Yi, Yuda An, Li Peng +11

Enterprise SSDs integrate numerous computing resources (e.g., ARM processor and onboard DRAM) to satisfy the ever-increasing performance requirements of I/O bursts. While these res…