Echo: Simulating Distributed Training At Scale

Yicheng Feng, Yuetao Chen, Kaiwen Chen +7

Simulation offers unique values for both enumeration and extrapolation purposes, and is becoming increasingly important for managing the massive machine learning (ML) clusters and…