4 citations · 7 across the 6 of their papers we have counts for
3 papers · 1 filter
INDIGO: Page Migration for Hardware Memory Disaggregation Across a Network
Archit Patke, Christian Pinto, Saurabh Jha +3
Hardware memory disaggregation (HMD) is an emerging technology that enables access to remote memory, thereby creating expansive memory pools and reducing memory underutilization in…
Story of Two GPUs: Characterizing the Resilience of Hopper H100 and Ampere A100 GPUs
Shengkun Cui, Archit Patke, Hung Nguyen +11
This study characterizes GPU resilience in Delta, a large-scale AI system that consists of 1,056 A100 and H100 GPUs, with over 1,300 petaflops of peak throughput. We used 2.5 years…
Hierarchical Autoscaling for Large Language Model Serving with Chiron
Archit Patke, Dhemath Reddy, Saurabh Jha +3
Large language model (LLM) serving is becoming an increasingly important workload for cloud providers. Based on performance SLO requirements, LLM inference requests can be divided…