Distributed Load Balancing with Workload-Dependent Service Rates

Wenxin Zhang, Santiago R. Balseiro, Robert Kleinberg +3

Modern service systems, including cloud platforms and large language model inference endpoints, must distribute jobs across servers whose processing speeds depend on current worklo…