101 citations · 155 across the 7 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.DC2025
Toward Co-adapting Machine Learning Job Shape and Cluster Topology
Shawn Shuoshuo Chen, Daiyaan Arfeen, Minlan Yu +2
Allocating resources to distributed machine learning jobs in multi-tenant torus-topology clusters must meet each job's specific placement and communication requirements, which are…
cs.DC2025
Nonuniform-Tensor-Parallelism: Mitigating GPU failure impact for Scaled-up LLM Training
Daiyaan Arfeen, Dheevatsa Mudigere, Ankit More +3
LLM training is scaled up to 10Ks of GPUs by a mix of data-(DP) and model-parallel (MP) execution. Critical to achieving efficiency is tensor-parallel (TP; a form of MP) execution…