On Topology's Role in ML Training Performance

Sarah McClure, Tegan Wilson, Brad Karp +4

Modern machine learning training workloads run on large-scale networks of compute accelerators. The networks commonly deployed in these systems are typically variations of two basi…