MLCC: A Congestion Control Technique to Accelerate ML Training

Anton A. Zabreyko, Sanjoli Narang, Sudarsanan Rajasekaran +1

We present MLCC, a novel technique to augment today's congestion control algorithms to accelerate DNN training jobs in shared GPU clusters in a fully distributed manner. At the hea…