activity
20182026
most citedMooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

13 citations · 13 across the 5 of their papers we have counts for

collaborators

7 papers

math.AP2026

pper and Lower Bounds for Blow-up Times in Coupled Reaction--Diffusion Systems with Nonlocal Sources

Xin Zhao, Aynuer Ailatusi, Xianfa Song +1

In this paper, we consider the following reaction-diffusion system \begin{equation*} \begin{cases} u_t=Δu+F\bigl(x,t,u,v,V(t)\bigr), & (x,t)\in\Om\times(0,T), v_t=Δv+G\bigl(x,t,u,v…

cs.RO2026

Efficient World Action Model Inference with Adaptive Intermediate States

Zhinnan Liu, Haozhi Han, Ruge Zhang +8

World Action Models (WAMs) enable future-aware control by jointly modeling actions and environment dynamics. However, iterative diffusion or flow inference incurs substantial denoi…

cs.DC2026

SAC: Disaggregated KV Cache System for Sparse Attention LLMs with CXL

Ruiyang Ma, Teng Ma, Junru Li +7

The scaling of LLMs toward long-context inference has shifted the primary serving system bottleneck from computation to memory capacity. Traditional solutions for dense attention m…

cs.DC2026

Surviving Partial Rank Failures in Wide Expert-Parallel MoE Inference

Xun Sun, Shaoyuan Chen, Pingchuan Ma +18

Mixture-of-Experts (MoE) serving relies on wide expert parallelism (EP) to aggregate the memory capacity and bandwidth of many GPUs within one inference instance. This efficiency c…

cs.DC2026

TENT: A Declarative Slice Spraying Engine for Performant and Resilient Data Movement in Disaggregated LLM Serving

Feng Ren, Ruoyu Qin, Teng Ma +16

Modern GPU clusters rely on complex, heterogeneous interconnects. As large language model (LLM) serving shifts toward agentic reasoning, KVCache becomes a first-class mobile asset,…

cs.DC2024★ 13 cited

Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

Ruoyu Qin, Zheming Li, Weiran He +4

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. It features a KVCache-centric disaggregated architecture that separates the prefill and de…

cs.DC2018

A Case for Asymmetric Non-Volatile Memory Architecture

Teng Ma, Mingxing Zhang, Kang Chen +2

The byte-addressable Non-Volatile Memory (NVM) is a promising technology since it simultaneously provides DRAM-like performance, disk-like capacity, and persistency. The current NV…