11 citations · 24 across the 4 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2021★ 11 cited
An Oracle for Guiding Large-Scale Model/Hybrid Parallel Training of Convolutional Neural Networks
Albert Njoroge Kahira, Truong Thao Nguyen, Leonardo Bautista Gomez +3
Deep Neural Network (DNN) frameworks use distributed training to enable faster time to convergence and alleviate memory capacity limitations when training large models and/or using…
cs.DC2020★ 4 cited
A Study of Checkpointing in Large Scale Training of Deep Neural Networks
Elvis Rojas, Albert Njoroge Kahira, Esteban Meneses +2
Deep learning (DL) applications are increasingly being deployed on HPC systems, to leverage the massive parallelism and computing power of those systems for DL model training. Whil…