Efficient Data-Plane Memory Scheduling for In-Network Aggregation

Hao Wang, Yuxuan Qin, ChonLam Lao +3

As the scale of distributed training grows, communication becomes a bottleneck. To accelerate the communication, recent works introduce In-Network Aggregation (INA), which moves th…