FlowTracer: A Tool for Uncovering Network Path Usage Imbalance in AI Training Clusters

Hasibul Jamil, Abdul Alim, Laurent Schares +6

The increasing complexity of AI workloads, especially distributed Large Language Model (LLM) training, places significant strain on the networking infrastructure of parallel data c…