2 citations · 2 across the 5 of their papers we have counts for
3 papers · 1 filter
Old is Gold: Optimizing Single-threaded Applications with Exgen-Malloc
Ruihao Li, Lizy K. John, Neeraja J. Yadwadkar
Memory allocators hide beneath nearly every application stack, yet their performance footprint extends far beyond their code size. Even small inefficiencies in the allocators rippl…
SpeedMalloc: Improving Multi-threaded Applications via a Lightweight Core for Memory Allocation
Ruihao Li, Qinzhe Wu, Krishna Kavi +4
Memory allocation, though constituting only a small portion of the executed code, can have a "butterfly effect" on overall program performance, leading to significant and far-reach…
Oneiros: KV Cache Optimization through Parameter Remapping for Multi-tenant LLM Serving
Ruihao Li, Shagnik Pal, Vineeth Narayan Pullu +4
KV cache accelerates LLM inference by avoiding redundant computation, at the expense of memory. To support larger KV caches, prior work extends GPU memory with CPU memory via CPU-o…