71 citations · 72 across the 3 of their papers we have counts for
3 papers
Cuttlefish: Low-Rank Model Training without All the Tuning
Hongyi Wang, Saurabh Agarwal, Pongsakorn U-chupala +3
Recent research has shown that training low-rank neural networks can effectively reduce the total number of trainable parameters without sacrificing predictive accuracy, resulting…
Massively Distributed SGD: ImageNet/ResNet-50 Training in a Flash
Hiroaki Mikami, Hisahiro Suganuma, Pongsakorn U-chupala +2
Scaling the distributed deep learning to a massive GPU cluster level is challenging due to the instability of the large mini-batch training and the overhead of the gradient synchro…
PRAGMA-ENT: Exposing SDN Concepts to Domain Scientists in the Pacific Rim
Kohei Ichikawa, Mauricio Tsugawa, Jason Haga +13
The Pacific Rim Application and Grid Middleware Assembly (PRAGMA) is an international community of researchers that actively collaborate to address problems and challenges of commo…