34 citations · 49 across the 12 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.LG2020★ 1 cited
Adaptive Braking for Mitigating Gradient Delay
Abhinav Venigalla, Atli Kosson, Vitaliy Chiley +1
Neural network training is commonly accelerated by using multiple synchronized workers to compute gradient updates in parallel. Asynchronous methods remove synchronization overhead…
cs.LG2020★ 9 cited
Pipelined Backpropagation at Scale: Training Large Models without Batches
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla +2
New hardware can substantially increase the speed and efficiency of deep neural network training. To guide the development of future hardware architectures, it is pertinent to expl…