activity
20232025
most citedSplitwise: Efficient generative LLM inference using phase splitting

6 citations · 11 across the 5 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.NI2024

ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics

Liangyu Zhao, Saeed Maleki, Yuanhong Wang +4

As modern DNN models grow ever larger, collective communications between the accelerators (allreduce, etc.) emerge as a significant performance bottleneck. Designing efficient comm…