Balanced allocation: considerations from large scale service environments

Amer Diwan, Prabhakar Raghavan, Eli Upfal

We study d-way balanced allocation, which assigns each incoming job to the lightest loaded among d randomly chosen servers. While prior work has extensively studied the performance…