2 papers
cs.LG2020
Convolutional Neural Network Training with Distributed K-FAC
J. Gregory Pauloski, Zhao Zhang, Lei Huang +2
Training neural networks with many processors can reduce time-to-solution; however, it is challenging to maintain convergence and efficiency at large scales. The Kronecker-factored…
cs.PF2019
HPC AI500: A Benchmark Suite for HPC AI Systems
Zihan Jiang, Wanling Gao, Lei Wang +10
In recent years, with the trend of applying deep learning (DL) in high performance scientific computing, the unique characteristics of emerging DL workloads in HPC raise great chal…