2 papers
cs.DC2025
SpeedMalloc: Improving Multi-threaded Applications via a Lightweight Core for Memory Allocation
Ruihao Li, Qinzhe Wu, Krishna Kavi +4
Memory allocation, though constituting only a small portion of the executed code, can have a "butterfly effect" on overall program performance, leading to significant and far-reach…
cs.OS2025
Oneiros: KV Cache Optimization through Parameter Remapping for Multi-tenant LLM Serving
Ruihao Li, Shagnik Pal, Vineeth Narayan Pullu +4
KV cache accelerates LLM inference by avoiding redundant computation, at the expense of memory. To support larger KV caches, prior work extends GPU memory with CPU memory via CPU-o…