4 citations · 33 across the 44 of their papers we have counts for
4 papers · 1 filter
DLB: Distributed Load Balancing at Scale for Generative AI Inference
Santiago R. Balseiro, Bartek Wydrowski, Sameer Agarwal +11
The reliance on scarce and expensive accelerators such as GPUs and TPUs in modern datacenters places unprecedented demands on backend infrastructure. For workloads characterized by…
Resource Allocation and Conversion along the Org Chart
Yuan Deng, Giannis Fikioris, Chido Onyeze +3
We consider the allocation of multiple heterogeneous resources to agents who are organized according to an organizational hierarchy. In a company those correspond to business units…
Quota Marketplace: Dynamic Pricing for Efficient Allocation of ML Training Resources
Balasubramanian Sivan, Renato Paes Leme, Mihai Tiuca +6
The escalating demand for Machine Learning (ML) training resources in recent years has resulted in a substantial gap between the high demand and the available supply. Efficient all…
Learning vs. Optimizing Bidders in Budgeted Auctions
Giannis Fikioris, Balasubramanian Sivan, Éva Tardos
The study of repeated interactions between a learner and a utility-maximizing optimizer has yielded deep insights into the manipulability of learning algorithms. However, existing…