In-Network Collective Operations: Game Changer or Challenge for AI Workloads?

Torsten Hoefler, Mikhail Khalilov, Josiah Clark +9

This paper summarizes the opportunities of in-network collective operations (INC) for accelerated collective operations in AI workloads. We provide sufficient detail to make this i…