2 citations · 2 across the 4 of their papers we have counts for
1 paper · 1 filter
Santiago R. Balseiro, Vahab S. Mirrokni, Bartek Wydrowski
Motivated by the growing demand for serving large language model inference requests, we study distributed load balancing for global serving systems with network latencies. We consi…