Load is not what you should balance: Introducing Prequal

Bartek Wydrowski, Robert Kleinberg, Stephen M. Rumble +1

We present Prequal (Probing to Reduce Queuing and Latency), a load balancer for distributed multi-tenant systems. Prequal aims to minimize real-time request latency in the presence…