Heddle: Learning Structural Templates for Parallelism Planning on Heterogeneous GPU Clusters

Taeyoon Kim, Yonguk Song, Seoyeong Choy +4

Training large machine learning models on shared GPU infrastructures faces two challenges: (1) GPU availability shifts dynamically with varying resource demands from tenants, and (…