most citedPOD-Attention: Unlocking Full Prefill-Decode Overlap for Faster LLM Inference

20 citations · 21 across the 2 of their papers we have counts for

collaborators
Showing cs.OSShow all

1 paper · 1 filter

cs.OS2023★ 1 cited

MaxMem: Colocation and Performance for Big Data Applications on Tiered Main Memory Servers

Amanda Raybuck, Wei Zhang, Kayvan Mansoorshahi +3

We present MaxMem, a tiered main memory management system that aims to maximize Big Data application colocation and performance. MaxMem uses an application-agnostic and lightweight…