4 papers
SPEC CPU2026: Characterization, Representativeness, and Cross-Suite Comparison
Ruihao Li, Andrew Jacob, Neeraja J. Yadwadkar +1
Specialized accelerators dominate AI workloads, but CPUs remain critical for latency-sensitive workloads, agentic AI, and many other everyday services. Their performance therefore…
Oneiros: KV Cache Optimization through Parameter Remapping for Multi-tenant LLM Serving
Ruihao Li, Shagnik Pal, Vineeth Narayan Pullu +4
KV cache accelerates LLM inference by avoiding redundant computation, at the expense of memory. To support larger KV caches, prior work extends GPU memory with CPU memory via CPU-o…
Old is Gold: Optimizing Single-threaded Applications with Exgen-Malloc
Ruihao Li, Lizy K. John, Neeraja J. Yadwadkar
Memory allocators hide beneath nearly every application stack, yet their performance footprint extends far beyond their code size. Even small inefficiencies in the allocators rippl…
SpeedMalloc: Improving Multi-threaded Applications via a Lightweight Core for Memory Allocation
Ruihao Li, Qinzhe Wu, Krishna Kavi +4
Memory allocation, though constituting only a small portion of the executed code, can have a "butterfly effect" on overall program performance, leading to significant and far-reach…