DeepCEE: Efficient Cross-Region Model Distributed Training System under Heterogeneous GPUs and Networks

Jinquan Wang, Xiaojian Liao, Xuzhao Liu +7

Most existing training systems focus on a single region. In contrast, we envision that cross-region training offers more flexible GPU resource allocation and yields significant pot…