5 citations · 10 across the 8 of their papers we have counts for
Showing cs.NIShow all
3 papers · 1 filter
cs.NI2024
ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics
Liangyu Zhao, Saeed Maleki, Yuanhong Wang +4
As modern DNN models grow ever larger, collective communications between the accelerators (allreduce, etc.) emerge as a significant performance bottleneck. Designing efficient comm…
cs.NI2023★ 2 cited
Bandwidth Optimal Pipeline Schedule for Collective Communication
Liangyu Zhao, Arvind Krishnamurthy
We present a strongly polynomial-time algorithm to generate bandwidth optimal allgather/reduce-scatter on any network topology, with or without switches. Our algorithm constructs p…
cs.NI2022★ 2 cited
Efficient Direct-Connect Topologies for Collective Communications
Liangyu Zhao, Siddharth Pal, Tapan Chugh +5
We consider the problem of distilling efficient network topologies for collective communications. We provide an algorithmic framework for constructing direct-connect topologies opt…