Toward Co-adapting Machine Learning Job Shape and Cluster Topology

Shawn Shuoshuo Chen, Daiyaan Arfeen, Minlan Yu +2

Allocating resources to distributed machine learning jobs in multi-tenant torus-topology clusters must meet each job's specific placement and communication requirements, which are…