4 papers
Ofan: Optimal Load Balancing for AI Training
Sarah McClure, Evyatar Cohen, Jakob Krebs +5
The extreme collective completion time (CCT) demands of AI workloads challenge existing packet spraying algorithms, which can have trouble efficiently load-balancing workloads that…
MoX: Efficient MoE Routing on Direct-Connect Topologies
Ori Cohen, Jakob Krebs, Daniel Amir +1
Optically switched networks suit the regular communication of dense ML models, but MoE introduces sparse, runtime-dependent traffic. We show that efficient offline-optimized routin…
SpraySense: Sensing Gray Failures through Packet Spraying Discrepancies
Jakob Krebs, Daniel Amir, Shir Landau Feibish +1
Distributed machine learning (ML) training has become a dominant workload in modern data center networks, operating at massive scale with clusters comprising tens to hundreds of th…
ACOS: Arrays of Cheap Optical Switches
Daniel Amir, Ori Cohen, Jakob Krebs +1
Machine learning training places immense demands on cluster networks, motivating specialized architectures and co-design with parallelization strategies. Recent designs incorporati…