2.5k citations · 2.6k across the 2 of their papers we have counts for
2 papers
cs.DC2020★ 117 cited
PyTorch Distributed: Experiences on Accelerating Data Parallel Training
Shen Li, Yanli Zhao, Rohan Varma +8
This paper presents the design, implementation, and evaluation of the PyTorch distributed data parallel module. PyTorch is a widely-adopted scientific computing package used in dee…
cs.CV2017★ 2.5k cited
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
Priya Goyal, Piotr Dollár, Ross Girshick +6
Deep learning thrives with large neural networks and large datasets. However, larger networks and larger datasets result in longer training times that impede research and developme…