1 citations · 1 across the 2 of their papers we have counts for
Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models
Mianjie Yu, Zhongmin Zhao, Zizhao Mo +9
Current heterogeneity-aware training systems for large models balance workloads by assigning unequal numbers of layers across pipeline stages, a strategy aimed at equalizing execut…
cs.DC2026★ 1 cited
Hotspot-Aware Scheduling of Virtual Machines with Overcommitment for Ultimate Utilization in Cloud Datacenters
Jiaxi Wu, Pavel Popov, Wenquan Yang +6
We address the problem of under-utilization of resources in datacenters during cloud operations, specifically focusing on the challenge of online virtual machine (VM) scheduling. R…
cs.DC2025
Huawei Cloud Model-as-a-Service on the CloudMatrix384 SuperPod
Ao Xiao, Bangzheng He, Baoquan Zhang +125
Scaled-out MoE LLMs and scaled-up SuperPods create new systems challenges for production Model-as-a-Service (MaaS), requiring disaggregation, low-latency communication, and decentr…