171 citations · 224 across the 7 of their papers we have counts for
4 papers · 1 filter
Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP
Deepak Narayanan, Fiodar Kazhamiaka, Firas Abuzaid +5
Resource allocation problems in many computer systems can be formulated as mathematical optimization problems. However, finding exact solutions to these problems using off-the-shel…
Allocation of Fungible Resources via a Fast, Scalable Price Discovery Method
Akshay Agrawal, Stephen Boyd, Deepak Narayanan +2
We consider the problem of assigning or allocating resources to a set of jobs. We consider the case when the resources are fungible, that is, the job can be done with any mix of th…
Don't Give Up on Large Optimization Problems; POP Them!
Deepak Narayanan, Fiodar Kazhamiaka, Firas Abuzaid +2
Resource allocation problems in many computer systems can be formulated as mathematical optimization problems. However, finding exact solutions to these problems using off-the-shel…
Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM
Deepak Narayanan, Mohammad Shoeybi, Jared Casper +9
Large language models have led to state-of-the-art accuracies across a range of tasks. However, training these models efficiently is challenging for two reasons: a) GPU memory capa…