Cloudless-Training: A Framework to Improve Efficiency of Geo-Distributed ML Training

Wenting Tan, Xiao Shi1, Cunchi Lv +1

Geo-distributed ML training can benefit many emerging ML scenarios (e.g., large model training, federated learning) with multi-regional cloud resources and wide area network. Howev…