4 citations · 4 across the 6 of their papers we have counts for
6 papers
MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression
Sheng Qiang, Ruiwei Chen, Yinpeng Wu +5
Long-context LLM services now sustain prompts with hundreds of thousands to millions of tokens, making the key-value (KV) cache a first-order serving cost. Because the cache grows…
Holistic Heterogeneous Scheduling for Autonomous Applications using Fine-grained, Multi-XPU Abstraction
Mingcong Han, Weihang Shen, Rong Chen +2
Modern autonomous applications are increasingly utilizing multiple heterogeneous processors (XPUs) to accelerate different stages of algorithm modules. However, existing runtime sy…
DuVisor: a User-level Hypervisor Through Delegated Virtualization
Jiahao Chen, Dingji Li, Zeyu Mi +4
Today's mainstream virtualization systems comprise of two cooperative components: a kernel-resident driver that accesses virtualization hardware and a user-level helper process tha…
Asymmetry-aware Scalable Locking
Nian Liu, Jinyu Gu, Dahai Tang +3
The pursuit of power-efficiency is popularizing asymmetric multicore processors (AMP) such as ARM big.LITTLE, Apple M1 and recent Intel Alder Lake with big and little cores. Howeve…
Taming Distrust in the Decentralized Internet with PIXIU
Yubin Xia, Qingyuan Liu, Cheng Tan +4
Decentralized Internet is booming. People are fascinated by its promise that users can truly own their data. However, in a decentralized Internet, completing a task usually involve…
Espresso: Brewing Java For More Non-Volatility with Non-volatile Memory
Mingyu Wu, Ziming Zhao, Haoyu Li +4
Fast, byte-addressable non-volatile memory (NVM) embraces both near-DRAM latency and disk-like persistence, which has generated considerable interests to revolutionize system softw…