Showing cs.LGShow all
2 papers · 1 filter
cs.LG2022
Convert, compress, correct: Three steps toward communication-efficient DNN training
Zhong-Jing Chen, Eduin E. Hernandez, Yu-Chih Huang +1
In this paper, we introduce a novel algorithm, , for communication-efficiency distributed Deep Neural Network (DNN) training. is a joint training/com…
cs.LG2021
Speeding-Up Back-Propagation in DNN: Approximate Outer Product with Memory
Eduin E. Hernandez, Stefano Rini, Tolga M. Duman
In this paper, an algorithm for approximate evaluation of back-propagation in DNN training is considered, which we term Approximate Outer Product Gradient Descent with Memory (Mem-…