240 citations · 240 across the 3 of their papers we have counts for
4 papers
Crossflow: Prefill-Decode Elasticity for Agentic LLM Serving
Yi Xu, Ehsan K. Ardestani, Wenyin Fu +7
As serving capacity demand surpasses that of training, serving efficiency becomes increasingly important. Prefill-decode (P/D) disaggregation improves serving efficiency through sp…
Provisioning to Runtime Optimization of a 100 MW-Scale AI Cluster
Ehsan K. Ardestani, Leonardo Piga, Jovan Stojkovic +19
The electric power supply for AI data centers is now the most significant bottleneck in the race toward Artificial General Intelligence, surpassing even the constraint of AI accele…
TPP: Transparent Page Placement for CXL-Enabled Tiered-Memory
Hasan Al Maruf, Hao Wang, Abhishek Dhanotia +7
The increasing demand for memory in hyperscale applications has led to memory becoming a large portion of the overall datacenter spend. The emergence of coherent interfaces like CX…
Live Recovery of Bit Corruptions in Datacenter Storage Systems
Amy Tai, Andrew Kryczka, Shobhit Kanaujia +6
Due to its high performance and decreasing cost per bit, flash is becoming the main storage medium in datacenters for hot data. However, flash endurance is a perpetual problem, and…