95 citations · 198 across the 9 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.LG2020
Highly Available Data Parallel ML training on Mesh Networks
Sameer Kumar, Norm Jouppi
Data parallel ML models can take several days or weeks to train on several accelerators. The long duration of training relies on the cluster of resources to be available for the jo…
cs.LG2020★ 1 cited
Training EfficientNets at Supercomputer Scale: 83% ImageNet Top-1 Accuracy in One Hour
Arissa Wongpanich, Hieu Pham, James Demmel +4
EfficientNets are a family of state-of-the-art image classification models based on efficiently scaled convolutional neural networks. Currently, EfficientNets can take on the order…
cs.LG2020★ 10 cited
Exploring the limits of Concurrency in ML Training on Google TPUs
Sameer Kumar, James Bradbury, Cliff Young +16
Recent results in language understanding using neural networks have required training hardware of unprecedentedscale, with thousands of chips cooperating on a single training run.…