3 papers
cs.PL2025
Old is Gold: Optimizing Single-threaded Applications with Exgen-Malloc
Ruihao Li, Lizy K. John, Neeraja J. Yadwadkar
Memory allocators hide beneath nearly every application stack, yet their performance footprint extends far beyond their code size. Even small inefficiencies in the allocators rippl…
cs.DC2025
SpeedMalloc: Improving Multi-threaded Applications via a Lightweight Core for Memory Allocation
Ruihao Li, Qinzhe Wu, Krishna Kavi +4
Memory allocation, though constituting only a small portion of the executed code, can have a "butterfly effect" on overall program performance, leading to significant and far-reach…
cs.OS2025
Oneiros: KV Cache Optimization through Parameter Remapping for Multi-tenant LLM Serving
Ruihao Li, Shagnik Pal, Vineeth Narayan Pullu +4
KV cache accelerates LLM inference by avoiding redundant computation, at the expense of memory. To support larger KV caches, prior work extends GPU memory with CPU memory via CPU-o…