SHORTCUT: In-Collective Topology Reconfiguration for Low-Latency AllReduce

Sarah-Michelle Hammer, Stefan Schmid, Anton Juerss +2

Distributed ML training relies on efficient AllReduce communication to aggregate data across nodes. In this setting, reconfigurable optical interconnects offer high-bandwidth, ener…