most citedSurvey on Large Scale Neural Network Training

8 citations · 8 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2022★ 8 cited

Survey on Large Scale Neural Network Training

Julia Gusak, Daria Cherniuk, Alena Shilova +8

Modern Deep Neural Networks (DNNs) require significant memory to store weight, activations, and other intermediate tensors during training. Hence, many models do not fit one GPU de…