10 citations · 10 across the 1 of their papers we have counts for
3 papers
cs.LG2021★ 10 cited
KAISA: An Adaptive Second-Order Optimizer Framework for Deep Neural Networks
J. Gregory Pauloski, Qi Huang, Lei Huang +4
Kronecker-factored Approximate Curvature (K-FAC) has recently been shown to converge faster in deep neural network (DNN) training than stochastic gradient descent (SGD); however, K…
cs.LG2020
Convolutional Neural Network Training with Distributed K-FAC
J. Gregory Pauloski, Zhao Zhang, Lei Huang +2
Training neural networks with many processors can reduce time-to-solution; however, it is challenging to maintain convergence and efficiency at large scales. The Kronecker-factored…
cs.DC2018
FanStore: Enabling Efficient and Scalable I/O for Distributed Deep Learning
Zhao Zhang, Lei Huang, Uri Manor +5
Emerging Deep Learning (DL) applications introduce heavy I/O workloads on computer clusters. The inherent long lasting, repeated, and random file access pattern can easily saturate…