2 papers
cs.DC2026
DLB: Distributed Load Balancing at Scale for Generative AI Inference
Santiago R. Balseiro, Bartek Wydrowski, Sameer Agarwal +11
The reliance on scarce and expensive accelerators such as GPUs and TPUs in modern datacenters places unprecedented demands on backend infrastructure. For workloads characterized by…
cs.DC2024
Distributed Load Balancing with Workload-Dependent Service Rates
Wenxin Zhang, Santiago R. Balseiro, Robert Kleinberg +3
Modern service systems, including cloud platforms and large language model inference endpoints, must distribute jobs across servers whose processing speeds depend on current worklo…