2 citations · 2 across the 2 of their papers we have counts for
1 paper · 1 filter
Tianyuan Wu, Wei Wang, Yinghao Yu +7
Fail-slows, or stragglers, are common but largely unheeded problems in large-scale hybrid-parallel training that spans thousands of GPU servers and runs for weeks to months. Yet, t…