TOAST: Fast and scalable auto-partitioning based on principled static analysis

Sami Alabed, Dominik Grewe, Norman Alexander Rink +5

Partitioning large machine learning models across distributed accelerator systems is a complex process, requiring a series of interdependent decisions that are further complicated…