NIXT: A NCCL Inspector Exporter Tool for Observability of Collective Communication in Large Model Training

Ziyang Jia, Sirshak Das, Jason Sewall +3

As machine learning workloads scale, it is increasingly important to gain more observability into the performance of collective communication to easily identify performance vari- a…